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Abstract 

In this paper, we consider to what degree the 
structure of a linear system is determined by 
the system's input/output behavior. The struc- 
ture of a hnear system is a directed graph where 
the vertices represent the variables in the sys- 
tem and an edge {x, y) exists if x directly in- 
fluences y. In a number of studies, researchers 
have attempted to identify such structures us- 
ing input/output data. Thus, our main aim 
is to consider to what degree the results of 
such studies are valid. We begin by showing 
that in many cases, applying a linear trans- 
formation to a system will change the sys- 
tem's graph. Furthermore, we show that even 
the graph's components and their interactions 
are not determined by input/output behavior. 
From these results, we conclude that without 
further assumptions, very few aspects, if any, 
of a system's structure are determined by its 
input/output relation. We consider a number 
of such assumptions. First, we show that for a 
number of parameterizations, we can character- 
ize when two systems have the same structure. 
Second, in many applications, we can use do- 
main knowledge to exclude certain interactions. 
In these cases, we can assume that a certain 
variable x does not influence another variable 
y. We show that these assumptions cannot be 
sufficient to identify a system's parameters us- 
ing input/output data. We conclude that iden- 
tifying a system's structure from input/output 
data may not be possible given only assump- 
tions of the form x does not influence y. 



1 Introduction 

The aim of this paper is to consider to what degree the 
structure of a linear system can be determined using in- 
put/output data. By the structure of a linear system, we 



mean a graph in which the vertices represent the vari- 
ables in the system and an edge from one variable to an- 
other exists if the second variable is directly influenced 
by the first one. 

1.1 Motivation 

This problem arose in a number of recent studies in 
which researchers have attempted to find the structure 
of a dynamical system using input/output data. For in- 
stance, researchers have attempted to find structure in 
the brain using fMRI data. In particular, Friston et al. 
[3] propose the method of dynamic causal modeling. In 
this method, the activity of regions in the brain is mod- 
eled by a bilinear system. Each state variable Zi of this 
system represents the activity in a particular region of 
the brain. The change over time of this activity is given 
by ©. 



i: = (A + ^ UiB{)z + Cu 
i=l 



(1) 



Here, u is the vector of inputs Ui to the model and 
Uu the number of such inputs. In dynamic causal model- 
ing, these inputs represent experimental conditions. For 
some of these inputs, the corresponding column in the 
matrix C will be non-zero, implying that they affect state 
variables directly. For other inputs, the corresponding 
matrix Bi is non-zero, allowing these inputs to indirectly 
influence the state variables by changing how these vari- 
ables affect each other. 

In addition to the bilinear model describing brain ac- 
tivity, Friston et al. use what they call a "forward model" 
that describes how this activity is measured. This model 
depends on the particular measurement method used, 
such as fMRI or EEC A forward model for fMRI mea- 
surements is given by Friston et al. [3 . 

To find structure in the brain, Friston et al. identify 
the parameters of both the bilinear model and the for- 
ward model. To do so, they assume the bilinear model 
has a particular form and the parameters that appear in 
this form and the forward model have certain given prior 
probability densities. Friston et al. then use the data to 
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find the posterior densities of the parameters. These 
densities can be used to make inferences about the pa- 
rameters. For instance, by testing whether a particular 
entry of A is non-zero, we can test if the data supports 
the hypothesis that one variable influences another in 
the absence of input. 

Goebel et al. [5] propose a different approach based 
on vector autoregressive (AR) models. In these models, 
a vector time-series Xn is computed using its own past 
values, as shown in ([2]). Here, the integer p is called the 
order of the vector AR model. The input m„ is a stochas- 
tic white noise input with a given cross-covariance ma- 
trix. Unlike Friston et al., Goebel et al. do not use inputs 
based on experimental conditions. 

p 

Xn — ^ ^ A{Xn-^i ~\- Uyi (2) 
i=l 

To quantify the influence of one variable on an- 
other, Goebel et al. use the concept of Granger causality. 
Goebel et al. distinguish two forms of this concept. The 
first of these is directed influence from one time series x 
to a time series y. We say that x causes y if we can better 
predict ?;„ using past values of both x and y, that is, the 
set Sx,y = {x„_i,?/„_i,x„„2,yn-2, • • • }, than using past 
values of y alone, i.e. the set Sy = {y„_i, 7;„_2, • ■ • }. 
The second form of Granger causality is instantaneous 
causality between x and y. This form of causality occurs 
if we can better predict y from Sx,y U than from 

Sx,y Goebel et al. note that though the first form of 
causality is directed, the second is not. 

To apply the concept of Granger causality to vector 
AR models, Goebel et al. create three such models. One 
model predicts x in terms of its past values and another 
model performs a similar task for y. The third model 
uses past values of both x and y to predict both x and 
y. Goebel et al. then use a number of measures based 
on the covariance matrices of the noise vectors that ap- 
pear in these models to quantify the presence of Granger 
causality between x and y. 

The two papers we have considered so far focused 
on identifying structure in the brain from fMRI data. A 
similar method can also be applied in other fields. An ex- 
ample of this is the application described in Hollanders' 
PhD thesis [B]. In this application, Hollanders consid- 
ers time series of the expression levels of the genes of a 
unicellular fungus. Hollanders' goal was to identify how 
these expression levels infiuence each other. To do so, 
Hollanders considers two model classes. One of these is 
the class of linear systems, the other a generalization of 
linear systems called piecewise linear systems. The state 
equation for one of Hollanders' linear systems is given 
by ([3]). In this equation, x{t) is the vector of gene ex- 
pressions at time u{t) is a vector of inputs and is a 



vector of Gaussian white noise. The matrices A and B 
are constant. 

x{t) = Ax{t) + Bu{t) + (3) 

Hollanders' second type of system, a piecewise linear 
system, is given by @. Conceptually, this system con- 
sists of a set of K linear subsystems as given by ([3]). At 
any given time t, the state is determined by subsystem 
l{t). Hollanders assumes that the system switches be- 
tween subsystems instantaneously. Therefore, l(t) is con- 
stant in between two moments when the system switches 
from one subsystem to another. 

xit) = Ai^t)x{t) + Bnt)u{t) + Ct (4) 

To find the way in which gene expression levels infiu- 
ence each other, Hollanders uses a system identification 
approach to find a system of either the form ^ or one 
of the form @ that fits the data. In order to find a 
unique solution, Hollanders' approach uses a trade-off 
between minimizing an error criterion and criteria based 
on norms of the resulting system matrices. 

A common feature of the papers we described above 
is that each paper proposes a method to find the struc- 
ture of a dynamical system from input /output data. By 
the structure of a dynamical system, wc mean a descrip- 
tion of which variable directly infiuences another vari- 
able. This structure can be represented as a directed 
graph, in which each vertex represents a variable and 
the edge (a;, y) exists in the graph if the variable repre- 
sented by X directly influences the variable represented 
by y- 

In the vector AR models of Goebel et al., we assume 
that the covariance matrix of the noise term is constant. 
This implies that the measures for Granger causality, 
which are based on these matrices, are constant for a 
given set of models. Therefore, the structure of a vector 
AR model as proposed by Goebel et al. will be constant. 

For a linear system given by ([3]), one variable influ- 
ences another if and only if a certain entry of either A or 
B is non-zero. Since the matrices A and B are constant, 
the structure of a linear system is also constant. This 
implies that the structure of each subsystem of a piece- 
wise linear system is constant. Thus, a piecewise linear 
system must have one of a given set of structures at any 
moment. This structure changes only when the system 
switches from one subsystem to another. 

In bilinear systems such as those used by Friston et 
al., the structure of the system is determined by the 
input signal. Therefore, the structure can change from 
moment to moment, dictated by changes in input. The 
way in which the inputs dictate the structure is, however, 
constant. 
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From the above discussion, we see that for a given 
system, either the structure is constant from moment 
to moment or a description of the possible structures 
exists. For the identification procedures of Goebel et al. , 
Friston et al. and Hollanders to be practically useful, the 
possible structures a system can have should be uniquely 
determined by input/output data. As mentioned, the 
goal of this paper is to describe to what degree this is 
the case for a linear system. 

1.2 Related work 

Before we consider how we will proceed and state our 
main conclusions, we note that related work has been 
done in the area of linear structured systems. Essentially, 
a linear structured system as used by Dion et al.[2] and 
other researchers is identical to what we call the struc- 
ture of a given linear system. The question considered 
by researchers in this area is what information about 
systems with a particular structure can be derived from 
the structure itself. As Dion et al. indicate, a number of 
properties will either not hold at all for systems with a 
given structure or hold for almost all systems with this 
structure. A property that holds for most systems with a 
structure is said to be generic for this system. Dion et al. 
give graph-theoretical criteria for genericity of a number 
of properties, such as controllability, observability and 
the solvability of a number of other control problems. 
Though this work is useful, it does not answer our basic 
question, namely how a given input/output relation de- 
termines the structure of systems realizing this relation. 

1.3 Contribution 

In this paper, we consider to what degree the struc- 
ture of a linear system can be determined using the in- 
put/output data it generates. First, we consider how 
linear transformations affect the structure of a linear sys- 
tem. Here, we see that for many linear systems, there 
exists a linear transformation that changes the structure 
of the system. Unless the linear transformation is part 
of a relatively small set, we have no guarantee that it 
does not change the structure of the system. 

In light of this result, we consider whether a weaker 
graph-theoretical relation than isomorphism could allow 
us to find some aspect of the structure that is conserved 
by linear transformations. For this purpose, we consider 
a number of variants of graph homomorphism. Unfortu- 
nately, each variant is either not an equivalence relation 
or leads to strange results where systems that should 
have different structures have the same structure. 

Given that linear transformations that result in iso- 
morphic graphs appear to be rare and variants of ho- 
momorphism lead to undesirable results, we apply graph 
isomorphism to condensed graphs. The condensed graph 
of a system is obtained from the original graph of the 



system by replacing each strong component by a sin- 
gle vertex. An edge exists from one component to an- 
other if a vertex in the first component had an edge to 
a vertex in the second component in the original graph. 
Unfortunately, the same problem we saw with graph iso- 
morphism applied directly to a system's graph also oc- 
curs with condensed graphs. That is, there exist linear 
transformations that result in systems with different con- 
densed graphs. 

The results discussed above indicate that if we do 
not make any assumptions about the system, very few, 
if any, aspects of the system's structure are determined 
by input/output data. Thus, it seems that we need to 
make assumptions about a system in order to determine 
its structure using this data. 

The first kind of assumption we consider is that the 
system is a minimal SISO system in some canonical form. 
In a number of special cases, these assumptions allow us 
to characterize the existence of isomorphisms between 
the graphs of two systems. In other words, we can char- 
acterize when two systems have the same structure. 

The second kind of assumption we consider is that 
some variables do not infiuence certain other variables. 
That is, we assume that some edges do not occur in the 
graph of our system. This implies that the graph of our 
system must be a subgraph of a given graph. Using this 
graph, a number of properties of systems satisfying our 
assumptions can be derived, as described by Dion et al. 
Our first result concerning these properties is that un- 
less there is no edge from a state variable to an output 
in the given graph, we cannot uniquely identify our sys- 
tem from input/output data. This implies that for a 
realistic system, where the state variables do influence 
the output, we cannot find the system parameters us- 
ing input /output data. In our second result, we give a 
graph-theoretical characterization of graphs such that al- 
most all systems satisfying the assumptions given by this 
graph are minimal. These conditions are also necessary 
conditions for any given system to be minimal. 

1.4 Application of the results 

Since the results described above apply only to linear 
systems, they are not directly applicable to the mod- 
els considered by Friston et al.[5], Goebel et al.[S] and 
Hollanders [B]. However, the linear systems we consider 
are strongly related to each of the model classes used by 
these researchers. For instance, if we set each matrix Bi 
to zero in ([T]) , we find the state equation of a linear sys- 
tem. Thus, we may identify the resulting system with 
a linear system where the output of the system equals 
its state. Due to the assumption that the system's out- 
put equals its state, we cannot directly apply a linear 
transformation to such a system. If we instead allow 
the output to be any linear transformation of the state. 
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we find a subset of tfie bilinear systems corresponding 
to ttie linear systems such that the input does not di- 
rectly influence the output. Many of our results apply 
to this set of linear systems. Since this set of systems 
is a proper subset of the set of all bilinear systems, we 
conjecture that these results may apply, possibly in a 
modified form, to the class of all bilinear systems. 

A similar relation exists between the linear systems 
we consider and the piecewise linear systems used by 
Hollanders. Indeed, if we ignore the noise term in ([3]) 
and allow the output of the system to be a linear combi- 
nation of its state, we find the same set of linear systems 
we considered above. In this case, we can generalize to 
piecewise linear systems by allowing the system to have 
an arbitrary number of subsystems. Since the systems 
with 1 subsystem are a subset of this more general class, 
we conjecture that many of our results may also hold for 
this more general case. 

The relation between the vector AR models consid- 
ered by Goebel et al.|S] and our linear systems is more 
complex. Though we can represent each vector AR 
model by a linear system driven by a stochastic input, 
our notion of this system's graph structure may differ 
from the Granger causality criteria used by Goebel et 
al. In some cases, these structures can give equivalent 
results. For instance, suppose we have two time series 
Xi g and yi G M". Suppose the best vector AR 
model of Xi and yi of the form ([2]) has block-diagonal 



matrices Ai, where Ai 



A 











A. 



A,. 



and Ai^y £ 



and the covariance matrix of the noise 
Un is also block-diagonal, i.e. this matrix has the form 











where Sj; S 



and "Ey € 



In this 



case, the graph of this system consists of two disjoint 
subgraphs, one for the vector AR model of Xi and one 
for the model of yi. Since the joint model of Xi and yi 
predicts each of these time series using only its own past 
values, we also find that there is no Granger causality 
between Xi and yi. Thus, we see that the graph struc- 
ture and Granger causality criteria can give equivalent 
results. It is unclear at this point whether and, if so, 
how, this holds in the general case. 

The remainder of this paper is structured as follows. 
In Section [5J we recall the definitions of a linear system, 
its associated graph and other relevant concepts. We 
then use these concepts in Section [3] to state the results 
we have discussed above. These results are proved in 
Section |4l In the final section, we briefly review our 
main results and their implications. 



2 Systems, graph structure and 
equivalent structures 

In this section, we recall the definition of a discrete-time 
LTI system and its associated graph structure. Given an 
initial state xq and an input sequence Uk, the evolution 
over time of the state Xk and output yk of the system is 
given by ^ and In these equations, the matrices 
A e K"-x"x, B e R"-x"", C G M"!'X«, audi) e R"«xn„ 
are constants. Since these constants uniquely determine 
the discrete-time LTI system, we define such a system to 
be a 4-tuple of the matrices A,B, C and D, as in Defini- 
tion [T] below. Similar definitions can be found in many 
textbooks on linear systems, such as those by Vaccaro 
[H] and Kailath [7]. 



Xk+l 

Vk 



: AXk 

Cxk 



■ Buk 
Duk 



(5) 
(6) 



Definition 1. An LTI state-space system with Uu in- 
puts, Uy outputs and rix state variables is a 4-tuple 
of matrices (A, B, C, Z?), where A e M"^x"x^5 g 

We define the structure of a state-space system as a 
directed graph whose vertices are the inputs, outputs and 
state variables of the system. An edge from one variable 
X to another variable y exists in this graph if y is directly 
influenced by x. We formalize this concept below. We 
begin by defining the graph of a matrix and then use 
this concept to define the graph of a system. Before we 
state these definitions, we briefiy recall the concept of a 
directed graph as defined in many textbooks on graph 
theory, such as the book by Chartrand et al.[Tl Ch. 7]. 

Definition 2. A (directed) graph G is a 2-tuple {V,E), 
where F is a finite set of objects called vertices and E C 

X is a set of 2-tuples of vertices called edges. 
Definition 3. Let M s M"'X«_ j^-^qj^^ the associated 
graph G of the matrix M is given by G = (V, E), where 
V = {vi,V2, ■ ■ ■ ,Vn} and E = {{vi,Vj)\Mji ^ 0}. 
Definition 4. The associated graph of the system 
S — {A, B, G, D) with n„ inputs, state variables and 
Uy outputs is defined as the graph G{S) — {V, E) = 

'A B (f 
0, 
_G D 0_ 

where n = + riu + riy and Mg G R"xn_ Addition- 
ally, we will use the following notation. The vertices vi 
through are called the state variable vertices of G{S). 
We will denote these vertices by Xi{G{S)) = Vi. The ver- 
tices Vn^+i through Vn^+n^ are called the input vertices 
of G{S), denoted by Ui{G{S)) — Wn^+i. Finally, the re- 
maining vertices are called the output vertices yi{G{S)), 
given by y^{G{S)) = Vn^+n,,+i- 



{{^1, V2, - ■ ■ ,«„},£') of the matrix Ms 
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Remark 1. Unless otherwise noted, G{S) denotes the 
graph of a Unear system as defined in Definition[T] When 
the graph we are referring to is clear from the context, 
we will abbreviate Xi{G(S)) to Xi. We will similarly 
abbreviate yi{G{S)) to yi and Ui{G{S)) to Ui. 

A useful corollary of Definition |4] is that only certain 
edges occur in the graph G{S). Furthermore, these edges 
occur if and only if the corresponding entries in the sys- 
tem matrices of S are non-zero. We state this formally 
below. 

Corollary 1. Let S — {A, B,C, D) be a linear system 
with n„ inputs, state variables and riy outputs. Then, 
in the graph G{S) = {V, E) of 5", each edge (v\,V2) is of 
one of the forms listed below. 

1. (xj, a;i),where 1 < j,j < 

2. (uj, Xi), where 1 < « < ria; A 1 < j < n„ 

3. (xj, yi), where 1 < i < A 1 < j < n^; 

4. (uj, yi), where 1 < « < rij, A 1 < j < n„ 
In addition, the following conditions hold. 

1. {xj,Xi) E E ii and only if Aij ^ 

2. {uj,Xi) G E ii and only if Bij ^ 

3. {xj, Ui) E E if and only if Cij ^ 

4. {uj,yi) e E ii and only if Dij =^ 

In this paper, we will consider a number of functions 
from the vertex set of one graph to the vertex set of 
another. We will restrict these functions to only map 
vertices onto vertices "of the same kind". That is, inputs 
must be mapped onto inputs, outputs onto outputs and 
so on. Formally, we say that the function must be type- 
restricted, as defined in Definition [5] below. 

Definition 5. Let Si be a linear system with nx,i state 
variables, inputs and riy^i outputs and 5*2 a linear 
system with nx.2 state variables, n,j.2 inputs and ny^2 
outputs. Then, the vertices vi G V{G{Si)) and V2 G 
V{G{S2)) are of the same type if one of the following 
conditions holds for some i and j: 

1. I < i < A 1 < j < n„.2 A UiiG{Si)) ^ vi A 

U,{G{S2))=V2 

2. I <i < ny,i A 1 < j < ny^2 A y^{,G{Sl)) = vi h 
y,{G{S2))^V2 

3. 1 < i < n^r 1 A 1 < j < ria; 2 A x^{G{Si)) = di A 

X,{G{S2))=V2 

Definition 6. Let 5*1 and 52 be linear systems and let 
G{Si) = {Vi, Ei) for i = l,2. A function (j) : Vi V2 is 
said to be type-restricted if, for 'a\\ v G Vi, v and <l)[v) 
are of the same type. 

We will now illustrate these definitions with an ex- 
ample. 



Figure 1: The associated graph G{S) in Example [T] 
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G{S) of S is 



Consider 
.[1 0],[2] 



the system S = 
The associated graph 



and (1)2 defined below, 
not. 



hi is type-restricted while 02 is 



X2{G{S)) iiv = xi{G{S)) 
(j)i{v)^ {xi{G{S)) iiv = X2{G{S)) 

V otherwise 

'ui{G{S)) iiv = xi{G{S)) 
Mv) ^ i xiiGiS)) iiv^uiiGiS)) 

V otherwise 

The first kind of function we will consider is an iso- 
morphism. A (directed-)graph isomorphism is defined in 
Definition [71 Unless otherwise noted, we will addition- 
ally require that the isomorphism is type-restricted as 
defined above. 

Definition 7. Let Si and ^2 be linear systems and let 
G{Si) = {Vi,Ei) for i = 1,2. A type-restricted function 
: Vi — 7> V2 is a type-restricted isomorphism if: 

1. is a bijection, that is, it is both injective and sur- 
jective. 

2. For any vertices u,v G Vi, {u, v) G Ei if and only if 
{<P{u),^{v))€E2. 

A type-restricted isomorphism as defined above may 
permute the inputs and outputs of a system. The results 
we derive in the remainder of this paper remain valid if 
we require a type-restricted isomorphism to leave the 
inputs and outputs in the same order. Thus, if desired, 
this condition may be added to Definition [T] 

In addition to the isomorphisms we have defined 
above, we will find it useful to consider isomorphisms 
on condensed graphs. The condensed graph correspond- 
ing to a given graph is the graph whose vertices are the 
components of the original graph. An edge from one 
component to another exists in the condensed graph if 
an edge from a vertex in one component to a vertex in 
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another existed in the original graph. To formally state 
the definition of a condensed graph and a condensed- 
graph isomorphism, we begin by stating the definition 
of a component. 

Definition 8. Let 5 be a linear system and let G{S) = 
{V, E) be its associated graph. For all a, 6 e let a o 5 
if and only if there exist directed paths from a to 5 and 
vice-versa in G{S). The relation ^ defined above is 
an equivalence relation. The equivalence classes of this 
relation are called the strong components of G{S). 

From the definition above, it is clear that the strong 
components of G{S) — (V, E) are sets of vertices that 
form a partition of V. In order to define the condensed 
graph GG{S) of S and type-restricted isomorphisms on 
such graphs, we will need to assign a type to each com- 
ponent of G(S). To do this, we recall an observation pre- 
viously made by Dion et al. in their survey of structured 
linear systems [5] • A formal proof of this observation is 
given in Appendix IA.2I 

Observation 1. Each input vertex Ui{G{S)) or output 
vertex yi(G{S)) is the only element of its component in 
GG{S). 

By the above observation, any component of G{S) 
with two or more elements must consist entirely of state 
variables. We will use this fact below to state the defini- 
tion of a condensed graph and type-restricted mappings 
between such graphs. 

Definition 9. Let be a linear system with n„ in- 
puts and Uy outputs and let G{S) — (Vg,Eg) be 
its associated graph. Furthermore, let ci,C2,--- ,Cm 
be the strong components of G{S) with more than 
one member. Then, we define the vertex set Vcg 
hy VcG = {ui(G(5)),u2(G(5)),--- ,M„„(G(5)),ci,C2, 
••• ,c„„yi(G(5)),y2(G(5)),-- - ,y„„(G(^))}. The edge 
set Egg contains the elements specified by the condi- 
tions below. The condensed graph CG{S) is the graph 
CG{S) = {Vgg,Egg). 

1. For all 1 < i < and 1 < j < m, {ui, Cj) e Egg if 
and only if a vertex v e Cj exists such that {ui, v) e 
Eg- 

2. For all 1 < i,j < m, {ci,Cj) G Egg if and only if 
vertices vi £ Ci and V2 G Cj exist such that {vi, V2) G 
Eg- 

3. For all 1 < i < m and 1 < j < Uy, {ci, yj) G Egg if 
and only if a vertex v G Ci exists such that (f , yj) G 
Eg- 

4. For all 1 < I < and 1 < j <ny, {ui,yj) G Egg 
if and only if {ui,yj) G Eg- 

In addition, we will denote the vertices Ui{G{S)) by 
Ui{GG{S)) and call these vertices input vertices. Simi- 
larly, the vertices yi{G{S)) will be denoted by yi{GG{S)) 



and will be called output vertices. Finally, we will call 
the vertices ci state variable component vertices and de- 
note them by Ci{CG{S)). 

Definition 10. Let Si be a linear system with n^^i in- 
puts and riy i outputs and S2 a linear system with n„^2 
inputs and ny^2 outputs. Furthermore, let nc,i, i = 1,2, 
be the number of state variable component vertices of 
CG{S{). Finally, let CG{Si) = {V^,E{), for i = 1,2. 
Then, a mapping </> : Vi — >■ V2 is type-restricted if, for all 
w G Vi, one of the following conditions holds for some i 
and j. 

1. 1 < i < n„.iAl <i< n„,2Au = u,{GG{S))^(t){v) = 
Uj{GG{S')) 

2. l<i <ny iM < j <ny2^v^ y^{GG{S)) A(j){v) = 
VACG{S')) 

3. l<i<nciM<i <nc2/\v = c,{GG{S)) A(l){v) = 
c,{GG{S')) 

Using the above definitions, we can define isomor- 
phisms on condensed graphs, which we will refer to as 
CG-isomorphisms. As we define below, two systems S 
and S' such that a CG-isomorphism exists between their 
condensed graphs are called CG-isomorphic. 

Definition 11. Let S and 5" be linear systems. 
Then, a type-restricted isomorphism between CG{S) 
and CG{S') is said to be a condensed-graph (CG-) iso- 
morphism between S and S' . If a CG-isomorphism be- 
tween S and S' exists, S and S' are said to be CG- 
isomorphic, written S '^cG S' . 

3 Main results 

3.1 Graph isomorphism and its 
inadequacy 

We begin by defining linear transformations of systems 
and considering how these transformations affect the 
associated graph of the system. Consider the system 
S = {A, B, G, D) with n„ inputs, state variables and 
Uy outputs. The evolution over time of the state vector 
Xk G M""= and output y^ G M"" of S, given an input 
Uk G M"", is given by ([S]) and ©• Let T be an invertible 
nx X nx matrix and Zk = Txk- Then, the evolution over 
time of Zk and yk is given by (O and ([5]). We define the 
result of transforming the system S using the matrix T 
to be the system with state vector Zk- This definition is 
stated formally below. 

Zk+i^TAT-^Zk+TBuk (7) 
yt^CT-^Zk+Duk (8) 

Definition 12. The result of transforming the system 
S = (A, G, D) with Hx state variables using an invert- 
ible Hx X Ux matrix T, denoted T{S,T), is the system 
(TAT~^,TB,CT-^,D). 
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Our first result is tliat in many cases, we can find a 
new system witli a non-isomorphic graph by diagonal- 
izing the A-matrix of tlic system. Thus, it is possible 
for a linear transformation to result in a system with a 
different graph. 

Theorem 1. For a system S = {A, B,C, D) , where A 
is diagonalizable hut not diagonal, there exists an invert- 
ible matrix T such that G{S) and G{T {S,T)) are non- 
isomorphic. 

On the other hand, there do exist matrices T such 
that G(T (S',r)) and G(S') are isomorphic for all S. For 
any positive integer n, we call the set of all such n x n 
matrices GI{n). The set GI{n) is a subgroup of the 
group of invertible n x n matrices, as stated below. 

Definition 13. The set GI{n) consists of the n x n 
invertible matrices T such that G{S) and G(T {S, T)) are 
isomorphic for all linear systems S with n state variables. 

Tiieorem 2. GI(n) is a subgroup of all invertible nxn 
matrices. Equivalently, the following conditions hold: 

1. In e GI{n) 

2. GI{n) is closed under matrix multiplication 

3. GI{n) is closed under matrix inversion. 

Though the above result shows that GI{n) has some 
algebraic structure, it does not indicate how many and 
which elements this group has. Below, we state two re- 
sults that show that certain classes of matrices are sub- 
sets of GI{n). One of these classes, the permutation ma- 
trices, is defined below. In Theorem[21 {mt} denotes the 
diagonal matrix whose diagonal elements are m^. Thus, 
{toi, 7712, • • • , m„} denotes the matrix M given below. 



Figure 2: The system Si from Example [2] 



M = 



rui 






7712 







Theorem 3. For any diagonal matrix M — {771^}, 1 < 
i <n, such that mi ^ for all i, M £ GI{n). 

Definition 14. For a permutation ei, 62, • • • , e„ of the 

integers 1, 2, • • • ,71, the corresponding 71 x 71 permutation 
matrix is the matrix P(ei, 62, • • • , e„) = (Pij), 1 < i, J < 
71, where is as given below. 



P — 



1 if j = 
otherwise 




Theorem 4. Any nxn permutation matrix is an ele- 
ment of GI{n). 



3.2 Graph homomorphism 

In most of this paper, we concentrate on graph isomor- 
phism. In principle, we could also have focused on a 
weaker relation, such as graph homomorphism. In this 
subsection, we state a number of results that indicate 
why we consider graph homomorphism to be inadequate 
for our purposes. We begin by defining a graph homo- 
morphism below. Intuitively, a graph homomorphism 
is a mapping from one graph to another that conserves 
edges. 

Definition 15. Let Si and ^2 be linear systems. Fur- 
thermore, let G{Si) = {Vi^Ei) for i = 1,2. Then, a 
type-restricted function : Vi V2 is a type-restricted 
homomorphism if for all u,v G Vi, {u,v) G Ei implies 
i^iu),cP{v))eE2. 

Our first example shows that the graph of every sys- 
tem is homomorphic to that of a standard system. 
Example 2. Consider the system Si = 
([1] , [1] , [1] , [1]). The graph of Si is shown in Figure 
[5] Next, consider an arbitrary system S — {A, B, C, D). 
The mapping ip defined below is a type-restricted 
homomorphism from 5' to 6*1. 

r 7ii(G(S'i)) if w = u,{G{S)) for some i 
= I yi{G{Si)) if t; - y^{G{S)) for some 7 
[xi(G(5'i)) if t; = Xi{G{S)) for some i 

If graph homomorphism were an equivalence relation, 
the above example would be problematic since every sys- 
tem would have the same structure. Fortunately, graph 
homomorphism fails to be symmetric, and so cannot be 
an equivalence relation. This fact is shown in the follow- 
ing example. 

Example 3. We will now show that, though a ho- 
momorphism from S to Si exists for all S, the op- 
posite is not necessarily the case. To do this, we 
consider the system 5*2 = ([O] ' [l] j [l] ' [O])' whose 
graph is shown in Figure [31 Since any homomor- 
phism (j) from 5*1 to S2 must be type-restricted, it 
follows that <p{xi{G{Si))) = xi{G{S2)). But then, 
by the definition of a type-restricted homomorphism. 
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Figure 3: The system 52 from Example [2] 

© — © — €) 

Figure 4: The system 5*3 from Example ID 




{xi{G{S2)),xi{G{S2))) should be an edge of G(52), since 
Ixi{gISi)),xi{gISi))) is an edge of G(S'i). Since this 
is not the case, no type-restricted homomorphism from 
Si to S2 can exist. 

One way to make homomorphism an equivalence re- 
lation is to require not just that a homomorphism from 
Gi to G2 exists, but also that a homomorphism from G2 
to Gi exists. Even with this interpretation, homomor- 
phism can lead to strange results, as we show below. 

Example 4. Our next example concerns the system 6*3 = 
'll 



, [0] j . The mapping (j) below is a ho- 



momorphism from S3 to 52, and similarly, tp is a, homo- 
morphism in the other direction. 





'^ii(G(52)) 


if V 


= ui{G{S3))\/v 


= U2(G(53)) 




yi(G(52)) 


if V 


= yi(G(53))Vt; 


-2;2(G(53)) 




.a;i(G(52)) 


if V 


= a;i(G(53)) 






'uiiGiSs)) 


if V 


= ^ii(G(52)) 






?/i(G(53)) 


if V 


= yi(G(52)) 






.a;i(G(53)) 


if V 


= a;i(G(52)) 





So, if we consider two systems to have the same struc- 
ture if homomorphisms exist between them in both di- 
rections, 52 and 53 have the same structure. 

In the above example, we show that the systems 52 
and 53 have the same structure. Intuitively, this should 
not be the case, since 52 and 53 have different numbers of 
inputs. From the above examples, we conclude that ho- 
momorphism, at least in the variants we have discussed 
here, is inadequate for our purposes since it will always 
lead to strange results. 



3.3 Condensed-graph isomorphism 

We will now consider how some of the results we derived 
earlier for graph isomorphism apply to condensed-graph 
isomorphism. Our first result is that the counterexam- 
ple we presented for graph isomorphism also applies to 
condensed-graph isomorphism. 

Theorem 5. A system S — {A, B, C, D) with A non- 
diagonal but diagonalizahle, is not CG-isomorphic to 
T(5, T), where D = TAT^^ is diagonal. 

In our next result, we show that there exists a class of 
systems whose condensed graphs contain 1 state variable 
component. Each of these systems has a diagonalizahle 
^-matrix, allowing us to transform each system to an- 
other system where each state variable is in a component 
of its own. 

Theorem 6. For each integer n, there exists a system 
5 = {A, B, G, D) with n state variables such that its 
condensed graph GG(5) contains 1 state variable com- 
ponent. In addition, the matrix A is diagonalizable but 
not diagonal, implying that there exists a system T (5, T) 
such that GG(T (5, T)) has n state variable components. 

The results above indicate that the condensed-graph 
structure of a system is not conserved by linear trans- 
formations. Since linear transformations do not change 
the input/output behavior of a system, this implies that 
systems with different condensed-graph structures may 
produce the same input/output data. Therefore, we can- 
not identify the condensed-graph structure of a system 
using input/output data unless we have additional as- 
sumptions about the system. In other words, to deter- 
mine the (condensed-)graph structure of a system, we 
need a parameterization of the set of linear systems we 
are interested in. Given a particular parameterization, 
we can ask when two systems in this parameterization 
have isomorphic structures. We will now consider this 
question for two parameterizations. The first parame- 
terization concerns the minimal SISO systems with di- 
agonal A-matrices. In the second parameterization, we 
consider minimal SISO systems whose A-matrices are in 
the natural normal forms given by Gantmacher [3]. 

For systems in the first parameterization, i.e. min- 
imal SISO systems with diagonal j4-matrices, we can 
characterize the existence of a type-restricted isomor- 
phism between two systems. This result is stated below. 

Theorem 7. The graphs of two minimal diagonal SISO 
realizations 5 = {A,B,G,D) and 5' = {A' , B' ,C' , D') 
will be isomorphic if and only if the following conditions 
hold: 



1. Either D ^ D' ^ or both D and D' 



are non-zero 



2. A and A' have the same number of non-zero ele- 
ments along their diagonals 
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In the second parameterization, a system's ^-matrix 
is in one of the normal forms given by Gantmacher [4]. 
These normal forms are based on the elementary divisors 
and invariant polynomials of the matrix A and are de- 
fined below. The concepts of invariant polynomials and 
elementary divisors are recalled in the Appendix. 

Definition 16. Let l{s) = s" + ais"-i + aas""^ H h 

Qn- The companion matrix L for the polynomial l{s) 
is the n X n square matrix shown below. As shown by 
Gantmacher [H Gh. 6], \XI — L\ = 1{X). Furthermore, 
all invariant polynomials ij of L other than ii are equal 
to 1, and so ii — \XI — L\. 



L 







-ttn 
-a„_i 
-a„_2 



1 



Definition 17. Let A be a real matrix and 
*2, • ■ ■ J V, V+i, • ' ■ *Ti be its invariant polynomials, 
such that the polynomials ii through ir are of positive 
degree and ij — 1 for r + l < j < n. Then, the first natu- 
ral normal form of A is the matrix L — {Li, ■ ■ ■ , Lr} 
Q where Lj is the companion matrix for the polynomial 
ij. 

Definition 18. Let ei, 62, • • • , be the elementary di- 
visors of A. The second natural normal form of A is the 
matrix L — {Li, L2, • • • , L^}, where Li is the companion 
matrix of e^. 

Remark 2. As Gantmacher [5] shows, every matrix A is 
similar to a matrix Ai in first natural normal form and 
a matrix A2 in second natural normal form. Thus, for 
every linear system S — {A, B, C, D), there exist systems 
Si = (Ai,5i,Ci,L'i) and S2 = {A^, 82,02,02) such 
that Ai is in first natural normal form, A2 is in second 
natural normal form and both and ^2 are similar to 
S. 

As we state below, if a SISO realization is minimal 
and its A-matrix is in first natural normal form, the ma- 
trix A is a companion matrix. This implies that the 
system will be similar to the well-known canonical forms 
of such systems. 

Theorem 8. If a SISO realization {A, B,C, D) is min- 
imal and the matrix A is in first natural normal form, 
A is a companion matrix. 

Unlike first natural normal form, second natural nor- 
mal form differs from the well-known canonical forms. 
In this form, the matrix A is block-diagonal and each 
block corresponds to an elementary divisor of the matrix 
A. Below, we give a characterization of CG-isomorphism 



'^Here, {Ai,A2,--- , An} denotes the block-diagonal matrix 
whose diagonal blocks are Ai , /±2 , ' ' ' , • 



between two realizations whose A-matrices are in second 
natural normal form. 

Theorem 9. Let Si = {Ai, Bi,Ci, Di) and S2 = 
{A2, B2,C2, D2) be two minimal SISO realizations where 
Ai and A2 are in second natural normal form such that 
is not an eigenvalue of either Ai or A2. Then, G{Si) 
and G{S2) are CG-isomorphic if and only if: 

1. The number of distinct irreducible polynomials that 
divide |A/ — ^i| equals the number of distinct irre- 
ducible polynomials that divide |A/ — A2 

2. Either Di = D2 = or Di A D2 ^ 

3.4 Components of condensed graphs 

In the previous section, we saw that the condensed-graph 
structure of a system is not uniquely determined by its 
input/output behavior. Thus, there may be a variety of 
systems S and associated graphs G{S) corresponding to 
any set of input/output data. In each of these graphs 
G{S), some sets of state variables do not interact with 
any variables outside the set itself. Such sets correspond 
to isolated components in the graph G{S) . By permuting 
the state variables of S, we can ensure that the variables 
in each component form a sequence of consecutive vari- 
ables, that is, they are the variables Xi,Xi+i, ■ ■ ■ ,XiJ^j, 
for some i and j. The resulting system will then have 
an A-matrix with a block-diagonal structure, where each 
isolated component in the graph corresponds to a diag- 
onal block. Conversely, if S has a block-diagonal A- 
matrix, each block of A corresponds to an isolated com- 
ponent in G{S). Thus, if we can find bounds on the 
number of diagonal blocks a block-diagonal realization 
similar to S may have, the same bounds should apply 
to the number of isolated components in the graphs of 
these realizations. In this section, we derive bounds on 
the number of diagonal blocks the ^-matrix of a sys- 
tem similar to a given system may have. To do so, 
we primarily consider the class of systems with block- 
diagonal A-matrices where each block is a companion 
matrix. However, the upper bound we derive applies to 
all block-diagonal realizations similar to the given sys- 
tem, no matter how their blocks are structured. 

Definition 19. A system 5* = {A, B, C, D) is said to be 
a block-companion realization if A is block-diagonal and 
each diagonal block Ai of A is a companion matrix. 

In our first result, we state that there exists a lower 
bound on the number of diagonal blocks of a block- 
companion realization similar to a given system. As we 
state in our second result, an upper bound on this num- 
ber of blocks also exists. 

Theorem 10. Let S = {A, B, G, D) be a given linear 
system. Furthermore, let (pi , \ < i < m be the irreducible 
polynomials that divide \XI — A\ and ki the number of 
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elementary divisors of A of the form (f)\. Then, every 
block- companion realization S' similar to S has at least 
k = maxi ki diagonal blocks. 



Theorem 11. Let S — {A, B, C, D) be a given linear 
system and let d be its number of elementary divisors. 
Then, any block- companion realization S' similar to S 
has at most d diagonal blocks. 



In the result below, we state that for any integer / 
between the bounds we have previously indicated, we 
can find a block-companion realization similar to S with 
I diagonal blocks. 



Theorem 12. Let S = {A, B, C, D) be a given linear 
system and let k and d be the lower and upper bounds of 
Theorems \lU\ and \ll\ resvectivelv. Then, for any integer 
I in the interval [k,d], there exists a block- companion 
realization similar to S with I diagonal blocks. 



As noted above, our main result is stated in terms 
of block-companion realizations. If we consider block- 
diagonal realizations whose blocks have arbitrary shapes, 
we find that the upper bound given above still applies. 
This fact is stated as a remark below. 



Remark 3. The upper bound of Theorem [TT] also applies 
to arbitrary block-diagonal realizations, regardless of the 
shape of the blocks. 



While the upper bound of Theorem [TT] remains 
valid for arbitrary block-diagonal realizations, the lower 
bound does not. A counterexample is given below. This 
example also indicates that this lower bound does not 
apply even if we consider only minimal systems. 



Example 5. First, we will construct a system whose ele- 
mentary divisors are A — 1, with multiplicity 3, and A — 2, 
with multiplicity 1. To do so, we note that the matrix A 
given below is in first natural normal form and has in- 
variant polynomials ii = {X — 1)(A — 2), i2 = is = A — 1. 
Let S = {A,Ii,Ii,0). Since B = C = I^, S is both 
controllable and observable. Thus, S is minimal, as re- 
quired. Next, we consider T{S,T), with T given below. 
As is readily verified, T (5, T) = (v4i, T, T^i, O) , where 
Ai is given below. We notice that Ai has two diagonal 
blocks, even though the lower bound of Theorem [TU] is 



three for S. 



A 



T 



Ai 



0-200 
13 
10 
1 



-1 
1 




1 

2 

1 

2 



1 

1 

2 

1 



1 

2 
1 
2 

-1 1 





1 
-1 
3 
1 



3.5 Structured systems and their 
graphs 

In many applications, we can assume that some vari- 
ables are not influenced by certain other variables. In 
other words, we can assume that a number of edges 
ivi,i,Vi,2),^ < i < I, do not occur in the graph of the 
system generating the input/output data under consid- 
eration. This assumption implies that the graph G{S) 
of this system is a subgraph of the graph G contain- 
ing all the edges we have not excluded, i.e. the graph 
G = {V,{{vi,V2) eV X V\^3i : vi = A V2 = v^^2}), 
where V is the set of vertices of the graph G{S). As we 
will see, many of the properties of systems in this class 
hold for almost all systems in the class. Furthermore, 
whether these properties hold for almost all systems can 
be determined by examining the graph G. We call the 
class of systems S such that their graphs G{S) are sub- 
graphs of G a structured linear system. Since the edges 
not present in G are absent in G{S) if and only if the 
corresponding entries in the system matrices of S are 
zero, a system 5* is a member of the structured linear 
system if and only if those entries are zero. Since the 
edges present in G may or may not be present in G{S), 
the other entries of the system matrices of S are uncon- 
strained, i.e. they are free parameters. We state a formal 
definition of a structured linear system below. 

Definition 20. Let T„xn = {(«, < i < m A 1 < 
j < n} and T{M) C Tmxn- The structured matrix M 
corresponding to the subset T{M) is the subset of M™^" 
given below. 

M = {M' e R"'^"|V(i,i) e T{M),Mlj = 0} 

The set of all to x n structured matrices is denoted by 

gm X n 

Definition 21. A structured linear system S with n„ 
inputs, Hx state variables and ny outputs is defined as a 
4-tuple {A,B,C,Df, where A e S;j-^"% B e S^^^"", 
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C e §,1" " and D e Sr" We say that S' = 

{A',B\C',D') e S if A' e A, B' (E B, C e C and 

D' e D. 

Above, we stated that the entries of a structured hn- 
ear system that were not set to zero are free parameters. 
To make this precise, we introduce the standard param- 
eterization of a structured hnear system. In this param- 
eterization, each entry in the system matrices that is not 
set to zero corresponds to a single variable. 

Definition 22. Let M G S™""" and let T(M) and 
Tmxn be given as in Definition 1201 Furthermore, let 
T(M) = Tmxn\T{M). Order the elements of T(M) ac- 
cording to the lexicographic ordering < {i' 
i < ~ i' Aj < f ). Let ii, • ■ • ^fe be the elements of 
T{M), enumerated in the above order. Then, the stan- 
dard parameterization of the structured matrix M is the 
function /m : M'^ -> M given by fuiv) = (eij(w)), with 



given below. 



if e r(A/) 



The standard parameterization /a/ is a bijection between 
and M. 

Definition 23. Let S = {A,B,C,Df and let /a : 
RfeA _^ jWiq standard parameterization of A, with 
fs, ks, fcj kc, Jd and defined similarly. Then, 
the standard parameterization of S is the function /s : 
+kB+kc+ko _^ s defined below. 



/s 



/ 


XA 






Xb 






xc 




V 


_xd_ 


) 



{fA{xA), fsixB), fcixc), foixD)) 



The standard parameterization /s is a bijection be- 
tween and S. We will denote /s(p) by 

A useful property of structured linear systems is that 
many of their properties hold for almost all of systems 
within the class given by a certain structured linear sys- 
tem. Properties that hold for "almost all" systems are 
said to be generic. Formally, we say that a property P 
is generic if all parameter vectors for which this prop- 
erty does not hold lie in the zero set of some polynomial. 
Equivalently, the set of parameter vectors for which P 
does not hold is a subset of a proper variety as defined 
below. 

Definition 24. Let / be a polynomial function in n 
indeterminates with real coefficients. Then, the subset 
Vf = {p € M"|/(p) = 0} is called the variety determined 
by /. If Vf ^ M", Vf is said to be a proper variety. 



Remark 4. In the remainder of this paper, we will denote 
the variety determined by / by V/. Conversely, if we 
denote a variety by Vf , the polynomial determining this 
variety is denoted by /. 

Definition 25. Let /s : M'^ — ;> S be the standard param- 
eterization of the structured linear system S. A property 
P is said to be generic for S if for all p G M'^ outside of 
a proper variety V ^ P holds for Sp. 

In our first result, we consider whether we can use in- 
put/output data to uniquely identify a particular mem- 
ber of a structured linear system. In other words, we 
consider whether knowing that certain edges do not oc- 
cur in the system's graph is sufficient to allow us to iden- 
tify the system. We say that a system can be uniquely 
identified using input / output data if there does not exist 
a system with exactly the same input /output behavior. 
This is stated formally below. 

Definition 26. S = {A,B,C,D) and S' = 
{A' , B' ,C' ,D') are equivalent if, given zero initial condi- 
tions, the outputs ys^k of S and ys',k of S' are identical 
for all fc > for all input sequences Uk- 

Definition 27. Let S be a structured linear system. 
Then, S is identifiable for p if no parameter vector q 
exists such that p ^ q and Sp and are equivalent. 

In the result below, we state that unless the system 
matrix C consists only of fixed zeroes, the structured 
linear system S is not generically identifiable. 

Theorem 13. Let S = {A, B, C, D)^ be a structured 
linear system such that at least one entry of C is not a 
fixed zero. Then, S is not generically identifiable. 

According to the result above, if a structured system 
S = {A,B,C,D)^ is generically identifiable, all entries 
of the matrix C are fixed zeroes. In other words, for any 
parameter value p, the output equation of the system Sp 
reads yk — Duk. Therefore, a structured system that is 
generically identifiable can only represent very restricted 
input /output mappings. 

Since all generically identifiable systems must have 
very limited modeling power, all structured systems that 
will occur in practical applications will not be generically 
identifiable. This implies that in real applications, the 
knowledge we have of the likely shape of the system's 
graph is insufficient to determine the system parameters 
exactly. In some cases, this knowledge may even be in- 
sufficient to uniquely determine the system's structure. 
To guarantee that the system's parameters can be found 
from input/output data, additional knowledge about the 
system is necessary. 

In the parameterizations we discussed in Section [3. 31 
we assumed that the system had a particular shape 
and that it was minimal. Together, these assump- 
tions allowed us to obtain characterizations of (CG- 
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) isomorphism between systems. In our second appli- 
cation of structured linear systems, we show how the 
latter assumption, that is, that a system is minimal, im- 
plies that a system's graph must satisfy a number of 
conditions. This result can be used with any particular 
parameterization to study the shape of the graph of a 
minimal system in this parameterization. In addition, 
this result shows that the assumptions we make about 
the properties a system has may affect its graph struc- 
ture. 

We begin by noting the following result, which states 
that a minimal system must be a member of some gener- 
ically minimal structured linear system. 

Theorem 14. A structured linear system S is generi- 
cally minimal if and only if there exists a minimal system 
Sp e S. 

This result implies that if a linear system S is mini- 
mal in the usual sense, the structured linear system cor- 
responding to its graph must be generically minimal. On 
the other hand, if the structured system linear system 
corresponding to the graph of S is generically minimal, 
this does not guarantee that S is minimal. 

An ordinary linear system is minimal if and only if it 
is both controllable and observable. As we state below, 
the same holds generically for a structured linear system. 

Theorem 15. A structured linear system S is generi- 
cally minimal if and only if it is both generically control- 
lable and generically observable. 

As given by Dion et al.[2,, graph-theoretical condi- 
tions for the generic controllability of a structured linear 
system exist. Applying these conditions, we find the 
graph-theoretical characterization of generic minimality 
stated below in Theorem 1161 The graph of a structured 
linear system, to which this characterization applies, is 
defined formally below. Intuitively, an edge exists in this 
graph if and only if the corresponding entry in the sys- 
tem matrices is not a fixed zero. 

Definition 28. The graph of a structured linear system 
S is the graph of the system S^, where v is the vector 
such that Vi = 1 for all i. 

Below, we define the concepts used in the statement 
of Theorem [Tni Similar definitions of these concepts are 
given by Dion et al.[2- 

Definition 29. Let S = {A, B, C, D)^ be a structured 
linear system. A finite sequence of vertices viV2 • ■ • Vk 
in G{S) such that no two vertices Vi and Vj are equal 
except possibly vi and Vk is called a path of length k. If 
^^1 = Vk, the path is called a cycle. Otherwise, the path is 
a simple path. Furthermore, if vi — Ui{G(S)) for some i, 
the path is called [/-rooted. Similarly, if — yj{G{S)) 
for some j, the path is said to be F-topped. 



Definition 30. A path uiU2 ■ ■ - Uk is said to cover the 
vertices ui through Uk- Two paths p = uiU2 ■ ■ ■ Uk and 
q — u'^u'2 ■ ■ ■ u'l are said to be disjoint if no vertex w exists 
such that both p and q cover w. 

A set of simple paths such that any two of them are 
disjoint is called a path family. If every element of the 
family is CZ-rooted, the family is said to be [/-rooted. 
Similarly, a path family of which every member is Y- 
topped is called F-topped. A set of cycles such that any 
two of them are disjoint is called a cycle family. 

The union of two path or cycle families Fi and F2 is 
said to be disjoint if for all pi G Fi and P2 & F2, pi and 
P2 are disjoint. 

Theorem 16. A structured linear system S is generi- 
cally minimal if and only if its graph G(S) satisfies the 
following conditions. 

1. Every vertex Xi{G{S)) is the end vertex of a U- 
rooted path in G(S) 

2. There exists a disjoint union of aU -rooted path fam- 
ily and a cycle family in G(S) that covers all the 
vertices Xi{G{S)) 

3. Every vertex Xi(G(S)) is the first vertex of a Y- 
topped path in G(S) 

4. There exists a disjoint union of a Y -topped path 
family and a cycle family in G(S) that covers all 
the vertices Xi{G{S)). 

As we have said previously, we can use the graph- 
theoretical characterization of generic minimality given 
by the previous result to determine if a given linear sys- 
tem may be minimal. This result is stated formally be- 
low. 

Theorem 17. If a linear system S is minimal, its graph 
must satisfy the conditions of Theorem \lb\ 

4 Proofs of the main results 

4.1 Graph isomorphism and its 
inadequacy 

We begin by stating the proof of Theorem [T] 

Proof of Theorem{Ji Since A is diagonalizable, there ex- 
ists an invertible matrix T such that A = TMT~^, where 
M is a diagonal matrix. Equivalently, M = T^^AT. 
This implies that T {S, T^i) = (Af, B' , G', D'), for some 
B', C' and D' . Since M is diagonal, no edge of 
the form {x^{G{T {S,T-^))),Xj{G{T {S,T-^)))) exists 
in G(T (S*, T~^)), for distinct i and j. However, since 
A was not diagonal, at least one edge of this form ex- 
ists in G{S). An isomorphism must preserve this edge, 
which is impossible. Therefore, G{S) and G(T {S,T-'^)) 
are non-isomorphic, as claimed. □ 
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In order to prove Theorem [21 we first take a closer 
look at the type-restricted isomorphism relation. We 
formally rc-define this relation below. 

Definition 31. The systems S and S' are said to be 
type-restricted isomorphic, denoted S* ~ 5', if a type- 
restricted isomorphism exists between G{S) and G{S'). 

As we state below, the relation defined above is an 
equivalence relation. The proof of this lemma is deferred 
to an appendix. 

Lemma 1. Type-restricted isomorphism (written S ~ 
S' ), is an equivalence relation, that is: 

1. S c:i S , for all S 

2. IfS~S', thenS' ~S 

3. IfS~ S' and S' ~ S" , then S ~ S" 

Using Lemma [U we can now state the proof of The- 
orem [21 

Proof of Theorem [H To prove the first condition, notice 
that T {S, In) = S for all S. Therefore, T {S, /„) ~ S. 

Next, let T,T' e GI{n) and let S be some realiza- 
tion. Then, T{S,T) ~ S, by the definition of GI{n). 
For the same reason, T (T [S, T) ,T')c^T {S, T), and so 
T(T(S',r),T') ~ S. Noticing that T(T(5,T),T') = 
T {S, T'T), we find that T'T € GI{n), as required. 

Finally, let T e GI{n). Then, let S' = T{S.T-'^), 
for some S. It follows that S = T(S",r). Therefore, 
~ S", by the definition of G/(n). Thus, S' ^ S and so 
T-i e GI{n). □ 

Next, we state the proof of Theorem [31 

Proof of Theorem [3 Let M be given and S = 
(A, B, C, D) be an arbitrary realization. Then, 
T{S,M) = {MAM-^,MB,CM-'^,D). Since M is 
diagonal, so is M~^, and = {m^^}. No- 

tice that if L = (iij)Il ML = (miLij). Simi- 
larly, iM-i = (L^jmJ^). Therefore, T (5, Af ) = 
{{miAijmJ^),{miBij),{Gijm~^),D). Since both rm 
and are clearly non-zero for all i, each entry of each 
matrix in T (S*, M) is non-zero if and only if the corre- 
sponding entry in S is non-zero. Therefore, the graph of 
S is the same as that of T {S, M), and so ~ T (5, M). 
Since S was arbitrary, M £ GI{n), as claimed. □ 

To prove that permutation matrices are elements of 
GI(n), we recall a number of properties of such matrices 
below. The first of these properties is proved in our ap- 
pendix. The second follows straightforwardly from ma- 
trix multiplication. 

Lemma 2. A permutation matrix P(ei,e2,--- ,e„) is 
orthogonal. 

^ (Lij ) denotes the matrix whose elements are Lij 



Lemma 3. For a matrix A — (Aij) and a permutation 
matrix P{ei,e2,- ■■ ,en), P(ei, 62, • ■ • , e„)^ = (Ae^j) 
and AP{ei, 62, • • • , e„)"^ = (^ie^ ); whenever these prod- 
ucts exist. 

Below, we show that permutation matrices are indeed 
elements of GI{n), proving Theorem [H 

Proof of Theorem^ Let S ^ ((Ay), {B,j), {G,,), (Aj)) 
and let P — P{ei, 62, ■ ■ ■ ,e„) be an arbitrary per- 
mutation matrix. By Lemma [31 P{Bij) = {B^^j) 
and (C,,)P^ = (Qe,). Similarly, P{A,j) = (Ae.j), 
and so P(Ay)P^ (^e.e,)- Thus, T{S,P) = 
(^{Ae-ej), {Be,j), (Ciej), D). Wc claim that (j) defined 
below is a type-restricted isomorphism between S and 
T{S, P). 

{u^{G{T{S,P))) iiv^udG{S)) 
0(f) = <2/.(G(T(5,P))) iiv^y,{G{S)) 
[x,{G{T{S,P))) iiv = XeAG{S)) 

From the definition of 0, it is clear that (j) is type- 
restricted. Since the integers ei, 62, • • • , e„ are a permu- 
tation of the integers from 1 through n, it is also clear 
that (/) is a bijection. Thus, we only need to verify that 
cf) preserves edges. To do so, we consider the four types 
of edges given in Corollary [I] 

First, we have edges of the form {xej,Xei). Then, 
4>{xi,^) = Xj and 4>{xei) — Xi. The edge {xj,Xi) exists 
in G{T{S,P)) if and only if {PAP'^),, = (Ae.e,),j = 
Ae^ej 7^ 0. Thus, this edge exists if and only if {x^^ , x^^) 
is an edge of G{S). 

Second, consider edges of the form {uj,Xei), which 
exist in G{S) if and only if Bf,.j ^ 0. By defini- 
tion, {(j){uj),4>{xei)) = {uj,Xi). This edge exists in 
G(T [S, P)) if and only if {PB),, = (Pe.j).j = Pe.j ^ 0. 
Thus, this edge is conserved. 

Third, consider an edge of the form (xej,yi), which 
is an edge of G{S) if and only if dej ^ 0. Using (j) again, 
((/)(xe, ), <l>{yi)) = {Xj,yi). This edge exists in G(T {S, P)) 
if and only if {GP^)ij = (Qe,),j = Qe, ^ 0. Therefore, 
edges of this form are also conserved. 

Finally, all edges of the form (ui,yj) correspond to 
edges {ui, yj), since outputs and inputs are not permuted 
by (p. Since both S and T (5, P) have the same ma- 
trix D, these edges are clearly conserved. Thus, 4> is 
a type-restricted isomorphism. Since S was arbitrary, 
P G GI{n). □ 

4.2 Condensed-graph isomorphism 

Below, we formally prove Theorem [5l 

Proof of Theorem\5^ First, wc note that since D is di- 
agonal, G(T (S, T)) has no components with more than 
one element. Thus, if G{S) has any components with 



(v. September 20, 2011, p.l3) 



Remco Bras 



Connectivity structure of systems 



more than one element, CG{S) and CG{T {S, T)) are of 
different order and so cannot be isomorphic. Second, if 
G{S) has no such components, CG{S) and GG{T (5, T)) 
are identical to G{S) and G'(T(5, T)) respectively. We 
have shown previously that no type-restricted isomor- 
phism between these graphs can exist. □ 

We will now prove Theorem [6] in two steps. In the 
first step, we construct a transfer function such that the 
realization in observable canonical form of this transfer 
function has 1 state variable component in its condensed 
graph. Then, we show that we can construct a transfer 
function of this type where the resulting realization has 
a diagonalizable ^-matrix. 

Lemma 4. Let H{s) = ''A^+a^A^-'t+^.'.+'L''" a given 
transfer function. Then, the condensed-graph of the ob- 
servable canonical form of H(s) contains exactly one 
state-variable component if On ^ 0. 



Proof. Consider 

ba\"+bi\"-^A hb„ 



A" +ai A" 



\-a„ 



a transfer function H{s) = 
The observable canonical form 
of H{s), as described by Vaccaro [H Ch. 3.3.2], is given 
hy S — {A,B,C,D), where A, B,C and D are given 
below. We notice that for all values of the coefficients 
fli, the edges {xi,Xi-i) for 2 < i < n exist in G{S). 
If a„ 7^ 0, the edge {xi,Xn) will also exist in G{S), 
completing a cycle containing all state variables. Thus, 
as claimed, G{S) will then have a single component 
containing all state variables. 



A = 



C 



-ai 10 

-02 10 

-as 1 

-On-l 

-a„ 



B = 



b2 



aibo 
a„6o 



1 



0] 



D - [bo] 



□ 



To complete the proof of Theorem El we construct a 
transfer function satisfying the conditions of the previ- 
ous lemma such that the observable canonical form has 
a diagonalizable A-matrix. This construction is given 
below. 

Proof of Theorem\^ Let H{s) = jy^j^) - Since (0-i) 
is non-zero for any 1 < i < n, the coefficient a„ of the 
denominator of Ii{s) is non-zero. Let S be the observ- 
able canonical form of H{s). As we have shown previ- 
ously, G{S) contains a component containing all state 
variables. 

Let A be the A-matrix of S. Since the eigenvalues of 
A are the poles of H{s), these eigenvalues are the integers 



from 1 through n. As A has n distinct eigenvalues, A is 
diagonalizable. Thus, we can find a matrix T such that 
G(T (S", T)) has n components containing state variables. 

□ 

In order to prove our isomorphism results, we intro- 
duce a number of concepts that we have found useful. 
Both of these concepts are sets of state variables. We 
recall from Definition |4] that the state variables in the 
graph G{S) of some system S are the vertices Xi{G{S)). 
The first concept is that of a trap, i.e. a set of state vari- 
ables with no edges to any vertex not in the set itself. 
The second is the similar concept of an unreachable set, 
i.e. a set of state variables such that no vertex outside of 
the set itself has an edge to any of the variables in the 
set. These concepts are defined formally below. 
Definition 32. A non-empty set of state variables S in 
the graph G of some system is called a trap if there does 
not exist a vertex x G S and a vertex y ^ S such that 
{x, y) is an edge of G. 

Definition 33. A non-empty set of state variables S in 
the graph G of some system is called an unreachable set 
if there does not exist a vertex x € S and a vertex y ^ S 
such that {y, x) is an edge of G. 

A useful property of traps and unreachable sets is 
that any system whose graph contains either an unreach- 
able set or a trap is non-minimal. We state this below 
in two lemmas. The proof of the first of these is in an 
appendix, the second has a proof very similar to that of 
the first. 

Lemma 5. A realization S — (A, -B, C, D) whose graph 
contains a trap is not observable, that is, its observability 
C 



matrix D 



CA 



has rank less than n. 



CA"-'^ 

Lemma 6. A realization {A, B, C, D) whose graph 
contains an unreachable set is uncontrollable, that 
is, the rank of its controllability matrix £ = 
[ B AB ■■■ A'^-'^B ] IS less than n. 
Remark 5. A result similar to Lemma [S] is described by 
Dion et al.[2]- Though we will not formally prove this 
here, the presence of an unreachable set in a system's 
graph is equivalent to the system's being in Form I as 
given by Dion et al. 2 . 

We now note that if, in = [A, B, C, D), the matrix 
A is diagonal, no edges between distinct state variables 
exist. Thus, each state variable is a trap if it has no edge 
to the output y, and an unreachable set if it has no edge 
from the input. We state this formally below. 
Observation 2. In the graph of a minimal diagonal re- 
alization , each state variable has an edge from the input 
and an edge to the output. 
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We now note that an isomorphism between diagonal 
realizations will preserve edges involving a state variable 
Xi if and only if it preserves edges of the form {xi,Xi). 
This is stated formally below. 

Observation 3. An isomorphism (j) between the graphs 
G = {V,E) and G' = {V',E') of two diagonal re- 
alizations may have (j}{xi) — Xj if and only if either 
{xi,Xi) e E A{xj,Xj) e E' or {xi,Xi) ^ E A{xj , xj) ^ E' 

Using the above observations, we will now prove The- 
orem [T] 

Proof of Theorem^ To prove necessity, let G{S) and 
G(iS") be isomorphic. Then, since {u,y) is an edge of ei- 
ther both G{S) and G{S') or of neither of these graphs, 
either both D and D' are non-zero or D = D' = 0. 
Since any isomorphism between G{S) and G(S") must 
conserve edges of the form {xi,Xi), G{S) and G{S') have 
equal numbers of vertices for which such an edge exists. 
Since each such vertex corresponds to a non-zero diag- 
onal entry of the matrix A or A' , the numbers of such 
entries are equal. 

To prove sufficiency, we construct a bijection 0. Let 
a^ii, Xi2, • • ■ , ximi be the state variable vertices in G{S) 
for which an edge of the form (xi, Xi) exists, that is, the 
state variable vertices corresponding to non-zero diago- 
nal entries of A. Let X21, 0:22, • • • , 2:27712 be the other state 
variable vertices of G{S). Define x[i,x'i2, • • • i^'imi ^^'^ 
X2i,a;22,-- - similarly for G{S'). Then, we claim 

that the function (p defined below is an isomorphism be- 
tween G{S) and G(S"). 



'MG{S')) 

yiiG{S')) 



iiv = ui{G{S)) 
iiv = y,{G{S)) 
ii V — xii 

if W = X2i 



(j) is clearly a bijection. It is also clear from the defi- 
nition of (/) that 4> is type-restricted. Thus, we only need 
to verify that (p preserves edges. Since S is minimal, we 
know that for any state variable Xi, {u,Xi) and {xi,y) 
are edges of G{S). For the same reason, we know the 
same holds for (j>{xi). Since both A and A' are diagonal, 
no edges between distinct state variables exist in either 
G{S) or G{S'). By the definition of 0, it is clear that (j) 
also conserves edges of the form {xi,Xi). Finally, since 
D and D' are either both zero or both non-zero, (u, y) 
is either an edge of both G{S) and G{S') or of neither 
of these graphs. □ 

To prove Theorem[51 we will use the following lemma. 
The proof of this result is deferred to an appendix. 

Lemma 7. //, for a SISO realization {A, B,C, D), the 
minimal polynomial ii of A is not equal to \XI — A\ the 
realization is non-minimal. 



Using the above lemma, we state the proof of Theo- 
rem \8\ below. 

Proof of Theorem [H Using the above lemma, we see 
that if 5' = {A, B, G, D) is a minimal SISO realization , 
the minimal polynomial ii oi A coincides with \\I — A\. 
Since the product of all minimal polynomials ij of A also 
coincides with |A/ — A\, ij — 1 for j > 1. Thus, the first 
natural normal form of A consists of a single diagonal 
block that is the companion matrix of ii = \\I — A\. 
Therefore, we have established Theorem |51 □ 

To prove our isomorphism result for realizations with 
^-matrices in second natural normal form, we begin by 
considering the graph of each block of the second natural 
normal form. As stated below, these graphs either have 
Hamiltonian cycles or are directed paths. 

Lemma 8. For an irreducible polynomial 4>{X), the 
graph of the companion matrix for polynomials of the 
form (f){X)^ , where k > 0, satisfies one of the following 
conditions: 

1. 0(0) ^ and the graph is Hamiltonian 

2. 0(0) = and the graph is a directed path. 

Since the graph of each block of A is a subgraph of 
the graph of 5' = {A, B,C, D), we have the following 
corollary of Lemma [S] 

Corollary 2. If S* = {A, B,G, D), where A is in second 
natural normal form, each block of A corresponds to 
either a Hamiltonian component or a directed path in 
G{S). 

By applying the ideas of traps and unreachable sets 
to realizations in second natural normal form, we find 
the following lemma. 

Lemma 9. If S ~ {A, B, G, D) is a minimal SISO re- 
alization and A is in second natural normal form, each 
component consisting of state variables in G{S) satisfies 
one of the following two conditions. Furthermore, these 
conditions are sufficient to guarantee that G{S) contains 
neither traps nor unreachable sets. 

1. The component is Hamiltonian and state variables 
Xi and Xj in the component exist .such that {u,Xi) 
and {xj,y) are both edges of G{S) 

2. The component is a directed path consisting of .state 
variables Xi, Xi+i, ■ ■ ■ ,Xi+m o,nd both {u,Xi) and 
{x^+rn,y) are edges ofG{S). 

Additionally, we obtain the below lemma and its 
corollary by applying Lemma [7] to realizations in second 
natural normal form. 

Lemma 10. If S ^ {A, B,C, D) is a SISO realization, 
where A has two elementary divisors of the form (f>{\)^ , 
for some irreducible 0(A), S is non-minimal. 
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Corollary 3. If 5 = {A,B,C,D) is a minimal SISO re- 
alization and A is in second natural normal form, the 
number of blocks in A equals the number of distinct ir- 
reducible polynomials that divide |A/ — A\. 

Using the above lemmas, we now state the proof of 
Theorem [9l 

Proof of Theorem\^ To prove necessity, suppose G{Si) 
and G{S2) are CG-isomorphic. Then, these graphs must 
have the same number of state-variable components. 
Since is not an eigenvalue of either Ai or A2, each 
block in Ai and A2 corresponds to a Hamiltonian com- 
ponent, by Lemma [5] Thus, the number of such blocks 
must be equal. The first condition then follows from our 
corollary above. To show the second condition, notice 
that the edge {u,y) in G{Si) must exist if and only if 
the same edge exists in G{S2)- The second condition is 
obtained by restating this in terms of Di and Z?2- 

To prove sufficiency, suppose the conditions are sat- 
isfied. Then, let ci, C2, • • • , Cm and c'j^, C2, • • • , c'^i be the 
state- variable components of G{Si) and G{S2) respec- 
tively. By our corollary above, Ai and A2 have an equal 
number of diagonal blocks. As used above, this implies 
that m = m' . We will now show that 0, as defined below, 
is a CG-isomorphism between G{Si) and G{S2)- 



(c) 



ui{CGiS2)) if c = Mi(CG(5i)) 
yi{CG{S2)) iic = y,{CG{S,)) 
c- if c = c: 



Clearly, is type-restricted and, since m = m' , is a 
bijection. Thus, we verify that cj) conserves edges. Since 
each diagonal block in both Ai and A2 is a companion 
matrix corresponding to a polynomial with no root equal 
to zero, each component is either non-trivial and Hamil- 
tonian or trivial and corresponding to a non-zero (1x1) 
matrix. Therefore, {ci,Ci) is an edge of GG{Si) for all 
i, and similarly for (c-,c-) in CG{S2)- Since each com- 
ponent corresponds to a diagonal block, no edge of the 
form {ci,Cj) for distinct i and j exists in CG{Si) and 
similarly in CG{S2)- Furthermore, since both realiza- 
tions are minimal, (u, Ci) and (q, y) are edges of CG{Si) 
and similarly in GG{S2)- Finally, (u,?/) is an edge of 
CG{Si) if and only if L>i ^ and similarly for CG(S2) 
and D2. Since Di and D2 are either both zero or both 
non-zero, (j) preserves this edge. □ 

4.3 Components of condensed graphs 

To prove our main results in this subsection, we 
will need the following theorem from Gantmacher ^ 
Ch. 6,Thm. 5]. This result allows us to find the ele- 
mentary divisors of a block-diagonal matrix using those 
of the diagonal blocks. 



Theorem 18. Let A ^ {AJ Ej. Then, A has all the 
elementary divisors of the Ai, and no others. 

We begin by proving Theorem [TUl i.e. that there 
exists a certain lower bound on the number of diago- 
nal blocks in a block-companion realization similar to a 
given system. To do so, we recall from our definition 
of a companion matrix that each companion matrix L 
has only one invariant polynomial not equal to 1. This 
implies that for any irreducible polynomial (p that di- 
vides I A/ — L I , L has exactly one elementary divisor of 
the form 0*^. 

Proof of Theorem\M Let 5" = [A', B' , C' , D') be an ar- 
bitrary block-diagonal realization consisting of compan- 
ion blocks that is similar to S. Each block of A' is a 
companion matrix and so cannot have two elementary 
divisors corresponding to the same irreducible polyno- 
mial. Since A' is similar to A, A' has the same elemen- 
tary divisors as A. Thus, there exists an integer i such 
that ki = k and A' has ki elementary divisors of the 
form (t)\. Since each block of A' has at most 1 elemen- 
tary divisor of this form. A' must have at least k such 
blocks. □ 

In a block-companion realization, each block of the 
matrix A corresponds to some nonzero number of ele- 
mentary divisors of A. Thus, the maximum number of 
diagonal blocks is the number of elementary divisors of 
A. This argument establishes the upper bound of The- 
orem [nj In our discussion above, we did not use the 
assumption that the diagonal blocks of A were compan- 
ion matrices. Thus, we have also proven Remark [31 

The proof of the remaining result. Theorem [1^ is 
split into two parts. First, we show that the bounds 
given by the previous two results are sharp. In other 
words, there exist realizations with a number of blocks 
equal to the lower bound and realizations with a number 
of blocks equal to the upper bound. These results are 
stated below as lemmas. The proofs of these lemmas are 
given in Appendix lA. 51 

Lemma 11. Let S — [A, B, C, D) and k he the hound 
of Theorem \1(A Then, there exists a hlock- companion 
realization S' similar to S such that S' has k diagonal 
blocks. 

Lemma 12. Let A have n elementary divisors. Then, 
there exists a hlock- companion realization similar to S = 
{A, B, C, D) with n diagonal hlocks. 

In the following lemma, we state that if we have a 
block-companion realization with I blocks, we can rear- 
range the elementary divisors of these blocks to find a 
block-companion realization with I + 1 blocks, provided 



•^Recall that {Ai} denotes the block-diagonal matrix consisting 
of the blocks Ai 
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one exists. This lemma allows us to prove the remainder 
of Theorem 1121 namely that a block-companion realiza- 
tion with I blocks exists for any integers I between the 
bounds indicated. 

Lemma 13. Let S = (A, B, C, D) be a block- companion 
realization such that A has n elementary divisors and 
I diagonal blocks. Then, either I = n or there exists a 
block- companion realization similar to S with I -\- 1 diag- 
onal blocks. 

Proof of the remainder of Theorem [IH By Lemma [TTl 
there exists a block-companion realization similar to 
S with k diagonal blocks. By applying Lemma [T3] 
I — k times, we can find a sequence of realizations 
5i,S'2,--- , Si-k such that Si is a block-companion re- 
alization similar to S and 5*^ has k -\- i diagonal blocks. 
Thus, Si-k is the required realization. □ 

4.4 Structured systems and their 
graphs 

The first result we will prove is Theorem [T31 To do so, 
we begin by stating the fact that T {S, M) and S have 
the same input/output relation in terms of our definition 
of equivalence. This fact is well-known and is stated in 
many textbooks on linear systems, such as the book by 
Vaccaro Section 3.3.4]. We reproduce a formal proof 
of this result in the appendix. 

Lemma 14. S = {A, B, C, D) and T (5, M) are equiva- 
lent for all M . 

The next step of our proof is to show that a struc- 
tured linear system satisfying the condition of Theorem 
n^is generically not identifiable. We note that this result 
is subtly different from our theorem, which requires us 
to establish that this kind of structured linear system is 
not generically identifiable. Still, the below lemma con- 
stitutes a major part of our proof. Hence, its proof is 
stated here in full. 

S 

Lemma 15. Let S = {A, B, C, D) be a structured lin- 
ear system such that at least one entry of C is not a fixed 
zero. Then, S is generically not identifiable. 

Proof. Let Xi be the parameter corresponding to the en- 
try of C that is not a fixed zero. Let Vf be the va- 
riety corresponding to f{x) = Xi. We claim that for 
p ^ V/, S is not identifiable. Thus, if S is identifi- 
able for g, q G Vf, from which our result follows. Let 
p ^Vf and Sp = {Ap,Bp,Cp,Dp). Then, T(Sp,2/) = 
{Ap, 2Bp, \Cp, Dp). Thus, every entry of T (Sp, 21) cor- 
responding to a fixed zero in S is zero, since these entries 
are zero in Sp. Therefore, T(Sp,2/) = S^ for some q. 
Furthermore, since qi — ^ and pi 7^ 0, ^ pi. Since Sq 
and Sp are equivalent, S is not identifiable for p. □ 



To complete the proof, we will need an additional 
lemma. This lemma states that if a property P, such as 
being not identifiable, holds generically, then its comple- 
ment, such as being identifiable, does not hold generi- 
cally. The proof of this result is deferred to an appendix 
since it is uses some technical concepts. 

Lemma 16. Let P be generic for S. Then, -iP is not 
generic for S. 

The above lemmas are sufficient to prove our result. 
Hence, we state the proof of Theorem [T51 below. 

Proof of Theorem \1S\ By Lemma lTSl S is generically not 
identifiable. The result then follows from Lemma [TBI □ 

To prove Theorem [TU we will use the following 
Lemma, which states that the parameter vectors for 
which a structured linear system is not minimal are al- 
ways elements of some variety. Since this lemma is nearly 
sufficient to prove our result, we will state its proof in 
full. 

Lemma 17. Let S be a structured linear system. Then, 
there exists a variety Vf such that for every parameter 
vector p, p G Vf if and only if Sp is not minimal. 

Proof. Let a; be a vector consisting of n indeterminates 
xi,X2, - ■ ■ ,Xn- Then, S^: is a system whose system ma- 
trices are polynomial matrices in the variables Xi. Let 
O be the observability matrix of S^, and C its control- 
lability matrix. Clearly, O and C are polynomial ma- 
trices in the variables Xi. Let fo be the sum of the 
squares of all maximal-order minors of O, and similarly 
for fc using minors of C. Thus, for any parameter vec- 
tor p, fo (p) = if and only if Sp is not observable, and 
fc{p) = if and only if Sp is not controllable. It follows 
that fo{p)fp{p) is zero if and only if Sp is not minimal. 
Thus, the variety Vf^f^ is the variety we require. □ 

The proof of Theorem [TJ] using the above lemma is 
stated below. 

Proof of Theorem \14\ By Lemma fTTl there exists a vari- 
ety Vf such that p € V/ if and only if Sp is not minimal. 
Thus, Vf is proper if and only if there exists a parameter 
vector p such that Sp is minimal. Therefore, if there ex- 
ists a parameter vector p such that Sp is minimal, Vf is 
a proper variety containing the vectors q for which S^ is 
not minimal. Thus, S is then generically minimal. If S 
is generically minimal, Vf must be proper, and so there 
exists a vector p ^ Vf such that Sp is minimal. □ 

Below, we state the proof of Theorem [T5l 

Proof of Theorem \15\ To prove necessity, assume S is 
generically minimal. Then, there exists a proper vari- 
ety Vf such that if Sp is not minimal, the parameter 
vector p G Vf. Let q be a parameter vector such that 
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Sq is not controllable. Then, Sg is not minimal, and so 
q & Vf. Thus, S is generically controllable. By the same 
argument, S is generically observable. 

To prove sufficiency, assume S is generically con- 
trollable and generically observable. Then, there exist 
proper varieties Vc and Vo such that p € Vc ii Sp is not 
controllable and p G Vo if Sp is not observable. Let Vm 
be the variety {p G M"|c(p)o(p) = 0}. Then, p G V„^ if 
and only if p G Vc or p G Vq. Thus, if Sp is not minimal, 
either p G Vc or p G Vo, and so p G Vm- Since the set 
of all polynomial functions over the real numbers in n 
indeterminates forms an integral domain, c ■ o 7^ 0, and 
so the variety Vm is proper. Therefore, S is generically 
minimal. □ 

To prove Theorem ll6l we first state graph-theoretical 
conditions for generic controllability. The following theo- 
rem states the conditions for generic controllability given 
by Dion et al.J5|. Dion et al.[2] note that similar results 
hold for generic observability. Unfortunately, we have 
not been able to find a suitable reference for these re- 
sults. 

Theorem 19. A structured linear system S = 
{A, B, C, D)^ is generically controllable if and only if the 
following conditions hold: 

1. Every state variable Xi is the end vertex of some 
U -rooted simple path in G'(S). 

2. There exists a disjoint union of a U -rooted simple 
path family and a cycle family that covers all state 
vertices. 

To derive conditions for generic observability, we will 
first show that a structured linear system is generically 
observable if and only if its dual system is generically 
controllable. The dual system of a linear system and a 
structured linear system is stated below. To define the 
dual of a structured linear system, we also define the 
transpose of a structured matrix. 

Definition 34. Let S = {A, B, C, D) be a linear sys- 
tem. The dual system of S is the system D {S) — 
{A^,C^,B^,D^). 

Definition 35. Let A he a. structured matrix deter- 
mined by T{A). The transpose oi A is the structured 
matrix determined by T{A^) = {{j,i)\{i,i) G T{A)}. 

Definition 36. Let S = {A,B,C,D)^ be a structured 
linear system. The dual system of S is the structured 
linear system D'^' (S) = (^4^, C^, B^, D^)'^. Here, the 
transpose of a structured matrix defined in Definition 1351 
is used. 

Remark 6. Let S be a structured linear system. Then, 
for every system Sp G S, there exists a system D'^ (S)^ G 
(S) that is the dual system of Sp. However, due to the 
way we have defined the standard parameterization of a 



structured linear system, the vector g is a permutation 
of the vector p. 

The result that a structured linear system is generi- 
cally observable if and only if its dual is generically con- 
trollable is stated below as a lemma. The proof of this 
result uses the well-known fact that a linear system is 
observable if and only if its dual is controllable and is 
deferred to an appendix. 

Lemma 18. A structured linear system S is generically 
observable if and only if its dual D"^ (S) is generically 
controllable. 

To use the above result to derive graph-theoretical 
conditions for generic observability, we need to formally 
state the relation between the graph of a structured lin- 
ear system and the graph of its dual. We state this rela- 
tion in the lemma below. Intuitively, this lemma states 
that the graph of a dual system is obtained from that of 
the original system by interchanging the inputs and out- 
puts of the system and reversing each arc of the original 
system's graph. The proof of this lemma is straightfor- 
ward but somewhat involved and is hence deferred to the 
appendix. 

Lemma 19. Let S be a structured linear system. Fur- 
thermore, let G(D^(S)) = {Vd,Ed) and G(S) = 
{Vs,Es). Then, the function f : Vd ^ Vs given be- 
low has the following properties: 

1. f is a bijection 

2. For all vi,V2 G Vd, ivi,V2) G Eu if and only if 

ifiv2)Jivi))eEs 

(x,{G{S)) if V = x,{G{I])^ (S))) 
/W = <y.(G(S)) if V ^ u,{G{BS (S))) 
[«,(G(S)) z/«-y,(G(D5(S))) 

In the lemmas below, we state the conditions that a 
system's graph will satisfy if and only if the graph of the 
system's dual satisfies the conditions for generic control- 
lability. Using Lemma [181 it is clear that these condi- 
tions are a graph-theoretical characterization of generic 
observability. The proofs of these lemmas involve an in- 
tuitive application of Lemma [121 The details of these 
proofs are deferred to an appendix. 

Lemma 20. Every state variable Xi{G(S)) is the first 
vertex of a Y -topped path if and only if every state vari- 
able Xi{G{I3^ (S))) is the end vertex of a U -rooted path. 

Lemma 21. There exists a disjoint union of a Y -topped 
path family and a cycle family in G(S) that covers every 
vertex Xi if and only if a disjoint union of a U-rooted 
path family and a cycle family exists in G(D'^ (S)) that 
covers every vertex Xi . 
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Using the above Lemmas, we can state the graph- 
theoretical characterization of generic observabihty. The 
proof of this resuh is straightforward and is hence de- 
ferred to an appendix. 

Lemma 22. S is generically observable if and only if 
every vertex xi in G(S) is the first vertex of a Y -topped 
path and there exists a disjoint union of a Y -topped path 
family and a cycle family in G'(S) that covers every ver- 

Below, we complete the proof of Theorem [TBI 

Proof of Theorem \16l By Theorem 1151 S is generically 
minimal if and only if it is generically controllable and 
generically observable. Using Theorem [THl we find the 
first two conditions. The remaining conditions follow 
from Lemma [221 D 

Finally, we will show that the graph-theoretical con- 
ditions we have previously derived are a necessary con- 
dition for a given linear system to be minimal. We state 
the proof of this result below. Before we state this proof, 
we formally define the structured linear system corre- 
sponding to the graph G{S) of a linear system S. 

Definition 37. Let S — {A, B, C, D) be a linear system. 
Furthermore, let T{A) — {{i,j)\Aij = 0} and similarly 
for T{B),T{C) and T{D). Then, let As be determined 
by T{A) and similarly for Bs, Cg and Dg- The struc- 
tured linear system corresponding to the graph of S is 
the system {As, Bg,Cs,Ds) ■ 

Proof of Theorem |i7[ Let S* be a minimal linear system 
and S' the structured linear system corresponding to the 
graph G{S). Since every entry of S is zero if and only if 
the corresponding entry in S' is a fixed zero, it is clear 
that the graphs G{S) and G{S') are identical. Further- 
more, it is clear that 5* G S'. Thus, since S is minimal, 
S' is generically minimal. Then, the graph G'(S') must 
satisfy the conditions of Theorem \W[ Since the graphs 
G{S) and G'(S') are identical, G{S) must also satisfy 
these conditions, as claimed. □ 

5 Conclusions 

In our introduction, we described a number of studies 
in which researchers attempted to identify the structure 
of a dynamical system from input/output data. In this 
paper, we have considered to what degree this structure 
is determined by the input/output relation of a linear 
system. 

We began by applying linear transformations to sys- 
tems. As we saw in Subsection 13. II such linear transfor- 
mations may change the system's graph structure. Fur- 
thermore, as we saw in Subsection 13.31 even the con- 
densed graph of a system is not necessarily conserved 



by linear transformations. Finally, as we stated in Sub- 
section 13.41 even the number of completely disconnected 
components in the system's graph is not determined by 
input/output behavior. 

The results described above indicate that many as- 
pects of a system's graph structure are not determined 
by its input/output relation. This implies that to iden- 
tify the structure of a linear system from input/output 
data, we require assumptions about the system. We have 
considered two possible forms of such assumptions. 

The first kind of assumption we considered was that 
the system under consideration has a particular canoni- 
cal form. For instance, the system might be a minimal 
SISO system with a diagonal A-matrix. We showed in 
Subsection 13.31 that we can characterize the existence of 
(CG)-isomorphisms between two systems satisfying this 
kind of assumption. In addition, we showed in Subsec- 
tion 13.51 that there exist certain conditions that must be 
satisfied by the graph of a minimal system. 

The second kind of assumption we considered was 
that the system was a member of a particular struc- 
tured system. That is, we assumed that some edges 
could not occur in the system's graph. As we showed 
in Subsection 13.51 assumptions of this kind are not suf- 
ficient to uniquely identify a system's parameters using 
input/output data. 

To summarize, our results have two implications for 
the identification of a system's structure. First, a sys- 
tem's structure is not uniquely determined by the sys- 
tem's input/output relation. Thus, we require additional 
assumptions to identify a system's structure. Second, 
the assumption that a given set of edges does not oc- 
cur in a system's graph may be insufficient to identify a 
system's structure. At the very least, this assumption is 
insufficient to uniquely identify the system parameters. 
Thus, even if the structure can be identified uniquely, 
the strength of the influence of one variable on another 
cannot be quantified. 

5.1 Future work 

As we remarked in the introduction, we conjecture that 
some of our results may apply, possibly in a modified 
form, to the models considered by Hollanders [Sj and 
Friston et al. 3 . We also remarked that the relation 
between the graph structure of a vector AR model and 
the Granger causality criteria of Goebel et al.l5] is still 
unclear. Thus, more work is needed to examine the im- 
plications of this paper for the models considered by Hol- 
landers, Friston et al. and Goebel et al. 

A Appendix 

This appendix consists of background material and tech- 
nical proofs. In the first subsection, we briefly recall the 
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concepts of the invariant polynomials and elementary di- 
visors of a matrix. The remaining subsections each con- 
tain the technical proofs that were omitted from the cor- 
responding section in the main text. In addition, these 
subsections contain minor lemmas that are only required 
for the technical proofs. 

A.l Elementary divisors and invariant 
polynomials 

Consider an n x n real matrix A and its characteristic 
matrix XI — A. Gantmacher [4, Ch. 6] shows that this 
characteristic matrix can be transformed to a diagonal 
matrix D, as shown below, by elementary row and col- 
umn operations. The diagonal elements of D are called 
the invariant polynomials of the characteristic matrix 
XI — A or equivalently those of the matrix A. An impor- 
tant property of the polynomials 11,12,^3, ■ ,in is that 
each divides the preceding one, that is ii — ii+ip, for 
some polynomial p. 

'in ••• " 

^ in-i •■• 

■■■ h _ 
Gantmacher also shows an equivalent definition of 
these polynomials using minors of XI — A. Let Di de- 
note the greatest common divisor of the minors of order 
i of A/ — A, with _Do — 1- Then, we can equivalently de- 
fine the invariant polynomials as ratios of these greatest 
common divisors, as follows; 



In the above definition of ii, notice that _D„ = 
|A/ — A|. This implies that ii is the minimal polyno- 
mial of A. As defined by Gantmacher jU Ch. 4], this 
polynomial is the polynomial iJj of least degree such that 
ip{A) — 0, where the first coefficient of ip is taken to be 
1. 

Using the above definitions of the invariant polyno- 
mials, we can define the elementary divisors of A. To do 
this, we factor each of the invariant polynomials ij of A 
into powers of irreducible polynomials (f)i, as shown be- 
low. The powers of these polynomials with exponents 
not equal to zero that appear in this factorization are 
called the elementary divisors of A. 

n = (02)'=^^ •••(</>™)'=^" 



A. 2 Technical proofs: Systems, graph 
structures and equivalent 
structures 

Proof of Observation]^ For input vertices, it is clear 
that no path from a vertex v to the input Ui(G{S)) exists, 
as input vertices have indegree zero. Thus, there exist no 
vertices v other than Ui{G{S)) such that v O Ui{G{S)). 
Therefore, Ui{G{S)) is the sole member of its component. 
The proof for yi{G{S)) is similar. □ 

A. 3 Technical proofs: Graph 

isomorphism and its inadequacy 

Proof of Lemma{^ To prove the first condition, consider 
the identity function on V{G{S)). Clearly, the identity is 
bijective and satisfies the second condition of Definition 
[T] It is also clear that the identity is type-restricted, and 
so S* ~ S*. 

To prove symmetry, let 5^5". Then, there exists a 
type-restricted isomorphism (j) : V{G{S)) V{G{S')). 
Clearly, the inverse (p^^ is bijective. This inverse also 
satisfies the second condition of Definition [71 since is 
surjective. For the same reason, the type-restriction con- 
dition must also be satisfied. Therefore, S' ~ S. 

To complete the proof, let 5^5" and S" ~ S". 
Then, there exist type-restricted isomorphisms (f>i : 
y(G(5')) ^ V{G{S')) and 02 : V{G{S')) ^ V{G{S")). 
The composition = 02 ° 0i is then a bijection from 
V{G{S)) to V{GiS")). This composition also satisfies 
the other conditions for a type-restricted isomorphism, 
as can be readily verified. □ 

Proof of Lemma\^ Since the rows of P(ei,e2,-- - ,e„) 
are a permutation of the rows of /„, they are 
clearly an orthogonal set of unit vectors. Therefore, 
P(ei, 62, • • • , e„) is clearly orthogonal. □ 

A. 4 Technical proofs: Condensed-graph 
isomorphism 

Proof of Lemma\B[ Let vi,V2,--- ,Vm be the indices of 
the state variables in the trap in the graph of G{S). 
Then, it is clear that {xy.,yj) is not an edge of G{S) 
for all i and j, or equivalently, that Gjy- = 0. For the 
same reason, for all integers j such that j ^ Vi for all 
i, Ajy. = for all i. Consider {GA)jy. — J^k^jk^kvf 
From the above discussion, we have for all k that either 
Gjk — or Akvi — 0. Thus, {GA)jy. = 0. By repeating 
this argument, we can show that the same holds for CA'^ 
for all k. Therefore, the columns wi, V2, • • • , Vm of D are 
zero. Since D has n columns, D cannot be of rank n. □ 

Proof of Lemma\^ Let ii ^ |A/ - A\. Since |A/ - A\ = 
zi gcd(adj (A/ — A)), where ad] {XI — A) is the adju- 
gate of XI — A, gcd(adj (A/ — A)) ^ 1. Consider the 
nominal transfer function H — ^'^xj^j^f ^^ ■ Since 



(v. September 20, 2011, p.20) 



Connectivity structure of systems 



Remco Bras 



\XI - A\ = gcd(adj (A/- and adj (A/ - A) = 
gcd(adj (A/ — ^))r, for some matrix T, H — 
g^^^.f ^y,7-^»'?^^ ^ CTB. Thus, H has a pole-zero 

gcd(adj(A/-A))ii ii ' ^ 

cancellation and so the realization {A,B,C,D) is non- 
minimal. □ 

Proof of Lemma\^ Since (j) is irreducible, either 0(0) ^ 
or (/)(A) = A™ for some m > 1. In the former case, this 

implies that in (j){X) = A™ -I- aiA™^^ H h a^, 7^ 0. 

Therefore, the top-right entry in the n x n companion 
matrix L corresponding to 0(A)*' is non-zero. Then, an 
edge (xn, xi) exists in the graph of L. Since the fixed ele- 
ments equal to 1 on L's subdiagonal correspond to edges 
{xi,Xi+i) for 1 < i < n, this graph has a Hamiltonian 
cycle. 

Otherwise, if 0(A) = A™, 0(A) = A™'=. Thus, in the 
n X n companion matrix L' corresponding to this case, 
the last column is zero. Then, the only edges that exist 
in the graph of L' are the edges {xi,Xi+i) for 1 < i < n, 
implying that this graph is a directed path. □ 

Proof of Lemma Since the realization S is minimal, 
every vertex in every component cannot be part of either 
an unreachable set or a trap. In the first case, if the 
component is Hamiltonian, if no edge of the form (u, Xi) 
exists for Xi in the component, the entire component is 
unreachable. Similarly, if no edge of the form {xj,y) 
exists for Xj in the component, the entire component is 
a trap. Therefore, edges of these forms must exist. Since 
the component is Hamiltonian, these conditions are also 
sufficient for the component to contain neither traps nor 
unreachable sets. 

In the second case, the component is a directed path 
consisting of the vertices Xi,Xi+i, • • • , Xi+m- If the edge 
(m, Xi) does not exist in G{S), {xi\ is an unreachable set, 
and so S is non- minimal. Similarly, if (x^+m, y) does not 
exist in G{S), {a;,;+„i} is a trap, and so S is non-minimal. 
Thus, the stated conditions must hold. Furthermore, if 
the conditions are satisfied, paths from u to Xi and from 
Xi to y exist in G{S) for all Xi in the component, and 
so the component does not contain traps or unreachable 
sets. 

By Lemma [SJ it is clear that each component con- 
sisting of state variables in G{S) is covered by one of the 
two cases above. Therefore, no such component can con- 
tain traps or unreachable sets, and so G{S) can contain 
neither traps nor unreachable sets. □ 

Proof of Lemma \10[ Let A have two elementary divisors 
0(A)'^i and 0(A)'^^. Since these elementary divisors are 
powers of the same irreducible polynomial, they cannot 
occur in the same invariant polynomial. After all, if they 
did, this invariant polynomial would only have a single 
elementary divisor 0(A) '^^ "'"'^^ . Therefore, two or more 
invariant polynomials of A are not equal to 1. Then, 



the minimal polynomial ii of A cannot coincide with 
I A/ — A\, and so by Lemma [71 S is non- minimal. □ 

A. 5 Technical proofs: Components of 

condensed graphs 
Lemma 23. Let (pi, 1 < i < I be the irreducible 
polynomials that divide |A/ — Furthermore, let Ei, 
I < i < m be sets of elementary divisors of A such that 
no two elements of Ei are of the form for the same j , 
for all i. Additionally, let each elementary divisor of A 
be an element of exactly one set Ei. Then, the m-tuple 
{El, E2, • • • , Em) corresponds to a block- companion real- 
ization similar to S = {A, B, C, D). 

Proof. Let h — YieeE < i < m, and Li be the 
companion matrix corresponding to U. We claim that 
A' = {Li} is similar to A. Since A' is block-diagonal, 
the elementary divisors of A' are those of the matrices 
Li, by Theorem [TSl Since each of the matrices Li is a 
companion matrix corresponding to the product of the 
elements of Ei , the elementary divisors of Li are the el- 
ements of Ei. Thus, each elementary divisor of A is an 
elementary divisor of A' , since we require that each such 
divisor is an element of some Ei . In addition. A' can have 
no other elementary divisors, as each element of each set 
Ei is an elementary divisor of A and each elementary 
divisor of A is in exactly one set Ei. Therefore, A' and 
A are similar. Thus, there exists a matrix T such that 
A' = TAT^K Therefore, T{S,T) is a block-companion 
realization similar to S, as claimed. □ 

Proof of Lemma \Tl\ Let 0^,1 < i < to be the irreducible 
polynomials that divide |A/ — A|. Furthermore, let eij 
be the j-th elementary divisor of A of the form 0', in 
some arbitrary order. Let Eij be a set of elementary 
divisors of A, defined as follows: 



Eij - 



{cij} if Cij exists 
otherwise 



Clearly, each elementary divisor Cij is an element of 
only Eij and no other set Eim- Thus, the fc-tuple t = 

(Ul<^<m-S^l:Ul<^<m^»2,••• ,Ul<i<m-E^ifc) COnsistS of 

sets of elementary divisors of A. It is clear that each ele- 
mentary divisor of A is an element of exactly one element 
of the tuple t. Furthermore, each element of the tuple t 
contains at most 1 elementary divisor of the form 0' for 
each polynomial 0^. Thus, by Lemma [221 t corresponds 
to a realization S' similar to S. S' is a block-companion 
realization with k diagonal blocks, as claimed. □ 

Proof of Lemma \lS\ Let A' be the second natural nor- 
mal form of A. Then, A' has n diagonal blocks and is 
a block-companion matrix. Furthermore, A' is similar 
to A. Thus, a matrix T exists such that A' = TAT^^. 
Therefore, T {S, T) is the required realization. □ 
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Proof of Lemma\T^ Let t = [Ei) be an Z-tuple of sets 
of elementary divisors, where Ei consists of the ele- 
mentary divisors of the i-th diagonal block of A. As- 
sume I 7^ n. Then, since each elementary divisor of 
A is a member of some set Ei, at least one set Ei 
consists of two or more elements. Let j be an integer 
such that Ej consists of two or more elements and se- 
lect an arbitrary element e of Ej. We claim that t' = 
{El,-- - ,Ej_i,Ej\{e},Ej+i,--- ,Eu{e}) is an [l + 1)- 
tuple satisfying the conditions of Lemma [231 Clearly, 
since none of the sets Ei contains two elementary divi- 
sors of the form for some irreducible polynomial 0^, 
neither do the elements of t' . The elements of t' are 
also clearly sets of elementary divisors of A. Further- 
more, since each elementary divisor is an element of ex- 
actly one set Ei, the same holds for the elements of t' . 
Thus, by Lemma the tuple t' corresponds to a block- 
companion realization similar to S with I -|- 1 diagonal 
blocks. □ 

A. 6 Technical proofs: Structured 
systems and their graphs 

ProoJ of Lemmaim Note that T{S,M) = 
{MAM~^,MB,CM-^,D). First, we show by in- 
duction that xj(^s,M),k — Mxs.k- Since we use zero 
initial conditions, Xf(^s,M),k = = MO = Alxsfl- In- 
ductively, xj(^s,M),k+i = MAM^'^xj(s,M).k + MBuk = 
M{AM-^Mxs,k + Buk) = M{Axs,k+Buk) = Mxs,k+i- 
Therefore, 2/T(s,M),fe = CM-^xjt^s,M),k + Duk = 
Cxs,k + Duk = ys.k- □ 

Proof of Lemma \lb\ Since P is generic for S, 
there exists a proper variety Vf such that 
{p G R" I P does not hold for Sp} C Vf. Suppose 
-iP is generic for S, i.e. there exists a proper variety 
Vg such that {p G R"|P holds for Sp} C Vg. Then, 
M" C VfVJVg and so VflJVg = R". Let h{x) = f{x)g{x). 
Then, Vf iJVg ^ Vh ^ M". Therefore, h is the zero 
function. But then, since the domain of polynomials 
over R in n indeterminates is an integral domain, either 
/ or g must be the zero function. Since Vf is proper, 
/ is non-zero for some x, and so g must be the zero 
function. But then, either Vg is not proper, which is 
impossible. □ 

Lemma 24. Let S ~ {A, B, C, D) he a linear system. 
Then, S is observable if and only ifJ} (S) is controllable. 

Proof. This result is implicitly given in the textbook by 
Kailath [7j. To formally prove it, notice that B (S*) — 
{A^,C'^,B'^,D'^). Thus, the controllability matrix 
of D(5) is Cd = [C^ A^C^ ■-- (A^r'^C^]. 
Since the observability matrix of S is given by Os = 



C 

CA 



, we notice that Cd = Oo. Thus, these ma- 



trices have the same rank, completing our proof. □ 



Proof of Lemma \18l To prove necessity, assume S is 
generically observable. Thus, there exists a proper va- 
riety Vf such that if Sp is not observable, p G Vf. Let 
g be the polynomial obtained from / by permuting the 
indeterminates in / such that for all p and q such that 
© (Sp) = (S)^, f{p) = if and only if g{q) = 0. Let 
q be an arbitrary parameter vector such that D'^ (S)^ 
is not controllable and let p be the vector such that 
D(Sp) = D'^ (S)^. Then, Sp is not observable, and so 
p ^ Vf. But then, q G Vg. Since / is not identically 
zero, neither is g, and so Vg is proper. Thus, (S) is 
generically controllable. 

The sufficiency of the condition follows from a similar 
argument. □ 

Proof of Lemma \7R The first property, that / is a bijec- 
tion, is clear from the definition of / and the definition 
of the dual ©•^(S). 

To prove the second property, let S — {A, B, C, D)^ . 
Then, D^(S) = ( A^ , , B^ , D'^f . We wiU consider 
all the types of edges that occur in G(D'^ (S)). First, con- 
sider edges of the form {xi,Xj), which exist in G{D^ (S)) 
if and only if Aj^ is not a fixed zero. Since Aj^ is a fixed 
zero if and only if Aij is a fixed zero, this edge exists if 
and only if {xj,Xi) is an edge of G'(S). Since f{xi) — Xi, 
this proves our condition for edges of this form. 

Second, consider edges of the form {ui,Xj), which 
exist in G{B)^' (S)) if and only if Cjl is not a fixed zero. 
Since Cj^ is a fixed zero if and only if Cij is a fixed 
zero, this edge exists if and only if {xj,yi) is an edge of 
G(S). Since f{ui) = yi and f{xj) = xj, this proves our 
condition for edges of this type. 

The arguments for the remaining edges are similar. 

□ 



Proof of Lemma \2(A To prove necessity, let 
XiViV2 ■ - ■ Vkyj be a F-topped path in G(S). Let / 
be the mapping of Lemma |19I Then, since / is a bijec- 
tion and the vertices Xi, Vi and yj are all distinct, so are 
the vertices f~^{xi),f~^{vi) and f~^{yj). Furthermore, 
since edges {xi,vi), {vi,Vi^i) and {vk,yj) exist in G(S), 
edges {f-\vi),f-\x,)), and 
{f'Hyj)J^Hvk)) exist in G(]D)^(S)). Thus, using the 
definition of /, we find that Ujv'iv'2 ■ • ■v'f.Xi is a path in 
G(ID)^ (S)), where v[ = f'^{v^). 

The sufficiency of the condition follows from the same 
argument. □ 
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Proof of Lemma \21\ To prove necessity, suppose a dis- 
joint union as described above exists. Then, every state 
variable Xi is covered by either a K-topped path or 
a cycle. Using the proof of Lemma [201 a state vari- 
able covered by a F-topped path is covered by a U- 
rooted path in G(D^ (S))- A similar argument shows 
that a state variable covered by a cycle in G(S) will 
also be covered by a cycle in GiJ}^ (S)). Thus, ev- 
ery K-topped path in the path family corresponds to 
a J7-rooted path in G(D'^ (S)), and every cycle cor- 
responds to a cycle. It remains to be shown that 
these paths and cycles are mutually disjoint. Thus, 
let viV2 - ■ -Vk and v'iV2 - ■ -v'j^ be disjoint paths or cy- 
cles in G(S). Then, the corresponding paths or cycles 
in G(B^(S)) are given by f-\vk) ■ ■ ■ f-\v2)f'\vi) 
and /^^(w^) • • • /^^(w2)/^^(wi)- Suppose these paths 
are not disjoint. Then, there exist i and j such that 
f~^{vi) = f~^{v'j). Since /^^ is injective, this implies 
that Vi — v'y This contradicts our assumption that the 
paths V1V2 ■ ■ ■ Vk and v'iv'2 ■ ■ ■ v'^. were disjoint. Thus, the 
corresponding paths in G(D^ (S)) must be disjoint. 

A similar argument in the other direction proves the 
sufficiency of the condition. □ 

Proof of Lemma By Lemma 1181 S is generically ob- 
servable if and only if the dual B'^ (S) is generically 
controllable. Furthermore, by Theorem [191 (S) is 
generically controllable if and only if every vertex Xi in 
G(D"^ (S)) is the end vertex of a [/-rooted path and there 
exists a disjoint union of a [/-rooted path family and a 
cycle family in G(D'^ (S)) that covers every vertex Xi. By 
Lemmas [20] and [21] these conditions are equivalent to the 
stated conditions on G(S), completing the proof. □ 
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